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However, both types of schools may face similar challenges in relation to assess- 
ment. Some ofthe issues mentioned by Elder are: lack of expertise (teachers may 
not be experts in language assessment); limited opportunities for test piloting; ap- 
propriateness of level for each learner; difficulty devising instruments that reflect 
aprogram's curriculum at a specific point and also serve as indicators of language 
achievement over a more extended period. Given these (and other) challenges, 
Elder outlines recommendations for effective use of heritage language tests in 
Australian schools. Elder highlights the importance of systematically document- 
ing relevant aspects of HL learners’ home language background, including lan- 
guage exposure, a recommendation that may be useful for HL community-based 
schools as well. Elder argues that such sociolinguistic profiling is essential in the 
beginning and throughout the program, and should be taken into account in the 
interpretation of test results. 
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6 Assessment in community-based heritage language programs 


This section has reviewed some of the relevant literature regarding general as- 
sessment practices in heritage languages. The next section discusses community- 
based heritage language programs, which strive to help children maintain their 
heritage language and culture, despite the many challenges faced, including the 
lack of adequate assessment instruments. 


3 Assessment in community-based heritage language 
programs 


Research on the assessment of HL children tends to revolve around bilingual pro- 
grams (e.g., Lucero 2018) or how to assess their progress in mainstream education 
(e.g., Gonzalez 2012). Practices in community-based schools have received less 
attention, even if, around the world, these programs support efforts to maintain 
and develop the linguistic and cultural skills of HL learners. Historically, these 
schools have been established and supported by groups interested in the main- 
tenance and development of their languages and cultures (Bradunas & Topping 
1988), though they may also be sponsored by both the community and a local 
public school or community college (Compton 2001). As Douglas (2005) notes, in 
the North American context most pre-college HL instruction is provided by these 
schools. Establishing and maintaining such schools involves many challenges, as 
outlined, for example, in Compton (2001) and Liu et al. (2011). Calling attention to 
the wide range of linguistic skills among HL learners, Compton (2001: 155) main- 
tains that “new approaches to placement, testing, teaching and learning for her- 
itage language students are crucial" At that time, Compton states, instruments 
for assessing HL learner skills were still in developmental stages. 

The diversity of students' language skills and backgrounds is, according to Liu 
et al. (2011), one of the challenges faced by community-based HL programs. Al- 
though Liu et al. mention that educators "would like information about placing 
students when their proficiency levels and backgrounds differ" (Liu et al. 2011: 5), 
the suggestions offered to address this particular challenge focus on instructional 
approaches and materials, not on assessing learner level for placement reasons. 
Assessment of learning outcomes is not included in other challenges related to 
instruction either (such as teaching materials and instructional time), possibly 
because other issues are considered more pressing for those schools. However, 
community-based HL programs may not be seen as schools by teachers and ad- 
ministrators. In an analysis of the curriculum of a Brazilian Portuguese HL pro- 
gram, Boruchowski (2014: 83) explains that the limited hours of contact with the 
children and the fact that teachers do not "grade or use measurement tests to 
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evaluate their students" leads teachers and administrators not to classify their 
own program as a school. Thus, assessment (or lack thereof) may be directly re- 
lated with how HL programs are perceived by those responsible for instructional 
decisions. 

In an article that proposes a theoretical framework for curriculum develop- 
ment for Japanese HL schools, Douglas (2005: 71) highlights that assessment 
methods must reflect the principles that were used as a basis for the curricu- 
lum. She calls attention to the elements of ideal assessment listed by Gutierrez 
& Slavin (1992), the principles of which can serve as a framework for developing 
assessment tools for young HL learners. The first element in the list seems espe- 
cially applicable to HL learners, given the range of abilities found among them: 
"Children are evaluated in terms of their own achievement and potential, not 
by comparison to group norms. Expectations differ for different children" (Dou- 
glas 2005: 71). The list also contains elements that relate to formative assessment, 
which, as Douglas (2008) and Carreira (2012a,b) maintain, is individualized in na- 
ture and, thus, necessary to address the needs of HL learners. Douglas (2005: 72) 
argues that assessment tools for young HL learners should address academic lan- 
guage as well as basic communication skills, given the varied HL environment 
to which children are exposed. 

Douglas (2008: 256) specifies that “in order to assess oral language develop- 
ment, assessment is conducted whenever possible while students are engaging in 
authentic meaning making activities.” Assessment of oral skills can be recorded 
in different ways, such as checklists, teacher observations, reports, and student 
interviews, among others. Douglas (2008) also discusses assessment of reading 
and writing abilities, providing examples of skills and categories that can be 
assessed. Results may reveal a mismatch between learners’ needs and the cur- 
riculum objectives. When this happens, Douglas (2008: 259) recommends that 
instructional goals be adjusted, reestablished or repeated. 

The evaluation of curriculum objectives based on assessment results is also 
proposed by Boruchowski (2015), who, following Wiggins & McTighe (2005), 
maintains that assessment should be used to assess whether instructional activ- 
ities did in fact help young HL learners reach learning goals. The importance of 
establishing curriculum goals for young HL learners is highlighted by Silva & 
Boruchowski (2016), who recommend that educators examine learners’ history 
of HL use and schooling in order to set specific objectives. Like Douglas (2005, 
2008), Silva & Boruchowski (2016) also assert that educators use formative as- 
sessment for young HL learners, including checks for understanding as well as 
performance tasks and projects. 
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Though not exhaustive, this literature review provides a base for discussing 
assessment in Brazilian Portuguese HL community-based programs. The next 
section describes the present study and is followed by a presentation of the an- 
swers elicited by the survey used. 


4 The present study 


Heritage language community-based schools play an important role in preserv- 
ing linguistic and cultural ties (Kondo-Brown 2010) and, thus, enriching any soci- 
ety. However, we do not have much information about how these schools assess 
learner progress and determine student readiness, and even less, if any, about the 
assessment of linguistic and cultural skills in less commonly taught HLs, such as 
Brazilian Portuguese. This study aims to shed some light on assessment practices 
in these HL schools and was guided by the following questions: 


e How are students placed in Brazilian Portuguese community-based 
schools? 


* Do these schools assess learner progress during the academic year? If so, 
how? 


* Do these schools assess learner progress at the end of the academic year? 
If so, how? 


In order to answer these research questions, approximately 80 educators con- 
nected to HL schools that teach Brazilian Portuguese in the United States (specif- 
ically, in Massachusetts and in Florida) were invited, via email, to participate in 
an anonymous online survey. Many (perhaps most) of these schools were cre- 
ated by community members who may have identified a desire by Brazilian im- 
migrants for their children to maintain and develop their language and culture. 
Blizzard & Batalova (2019) show that, according to American Community Sur- 
vey data, approximately 450,000 Brazilian immigrants lived in the U.S. in 2017. 
The authors add that about 32% of those immigrants resided in Florida and Mas- 
sachusetts. These patterns of immigration may account for the creation of several 
community-based schools in these two states. Although I do not have specific 
information about the schools these educators were connected with, in my expe- 
rience most Brazilian Portuguese HL community-based schools are funded with 
student tuition, though some may establish partnerships with Brazilian compa- 
nies and/or obtain limited funding from the Brazilian government, as mentioned 
earlier in the case of ABRACE. 
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About two weeks after the first email, another email invitation to take part in 
the anonymous online survey was sent to the same list. The survey contained 
nine questions (see Appendix A), four of which required an answer, while the 
other five were dependent on other questions, that is, five questions would be 
answered depending on the answer provided in the required questions. Six ques- 
tions were open-ended, which leads to a mostly qualitative analysis of the results. 
Questions addressed placement, assessment during the academic year, and sum- 
mative assessment. A total of 19 respondents completed the survey, but answers 
by one participant were excluded because it was evident that s/he does not work 
at a community-based HL school, but rather at a regular school (possibly in a 
bilingual program). Answers were collected within the online survey tool used 
to design and distribute the survey. The results are presented in the next section. 


5 Survey results 


This section presents the answers to the online survey provided by 18 partici- 
pants. The first question (Q1) in the survey addressed the period before classes 
started, asking whether anyone at the school spoke with the parents or guardians 
of new students. All of the respondents answered that there were in fact people 
who spoke with parents prior to the child joining the program and proceeded to 
answer the second question (Q2), which depended on an affirmative answer for 
the first and focused on the goal of the conversation. Since Q2 was open-ended, 
a few participants mentioned more than one objective for the conversation with 
the parents of new students (and, in the case of one respondent, parents of re- 
turning students as well). The answers revealed some common themes, as well 
as topics that were unique among the participants. The list below summarizes 
the reasons for the conversation with the parents of new students: 


e to explain logistical issues about the school and classes, as well as their 
goals and methods (nine respondents); 


e to elicit information about the child's linguistic abilities (eight respon- 
dents); 


* to raise parents' awareness of the importance of the Portuguese language 
in their children's lives (four respondents); 


e to discuss the role of the Brazilian Portuguese school in the community 
(one respondent); 
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e to have parents fill out a form with questions about the child (one respon- 
dent); 


e to learn what the child expects from the classes (one respondent). 


The third question in the survey (Q3) was one of the multiple-choice questions. 
It sought to elicit how new students were placed (and answer the first research 
question guiding this study). Possible answers were: (a) according to age only; 
(b) according to the result of an evaluation and/or interview; (c) according to age 
and the result of an evaluation and/or interview; and (d) other. No participant 
elected “other”. Most respondents (n = 10) chose (c): their schools adopt a mixed 
approach to placement, which is based on age as well as the result of some type 
of evaluation of the child's abilities. Six participants reported that students are 
placed according to age only, while placement in two schools follows the result 
of a test and/or interview. 

Participants who did not choose (a) in Q3 (n - 12) were invited to answer Q4, 
Q5, and Q6. Q4 asked respondents to describe the instruments used to place new 
students. A combination of interview and a written test was mentioned by five re- 
spondents, while three participants answered that their institutions placed new 
students after an interview only. Another two respondents stated that new stu- 
dents took a test (“a little evaluation”; “a vocabulary and reading test"). Two par- 
ticipants mentioned a combination of age and a survey filled out by parents, in- 
cluding one who explained that very young students (2-4 years old) were placed 
according to age only. 

Next, Q5 sought to elicit who is in charge of assessing the new students, and 
how long that assessment takes (be it an interview, a test or a combination of 
both). Six respondents said that either the school director or a pedagogical coor- 
dinator assessed new students, while five participants answered that the teacher 
was responsible for that assessment (two of those respondents mentioned that 
such assessment was carried out in the first few classes). One participant wrote 
simply “according to each student's needs.” One participant who had checked 
(a) in Q3 (new students are placed according to age only) did answer Q5 and ex- 
plained that they “assess children’s progress every class”, and if they notice that a 
child is mature for his/her age and is more advanced than their class, they speak 
with the parents and, if everyone agrees, the child is moved to another level (pro- 
vided there is not a significant age difference between the child in question and 
those in the more advanced level). As for how long the assessment to place new 
students takes, only six participants specified the duration, which ranged from 
10 minutes to four classes (or one month, since classes take place on Saturdays), 
including 15 minutes, 30-45 minutes, 60 minutes on average, and one class. 
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Still following up on placement of new students, Q6 addressed when it took 
place and when and how parents were informed of the decision about placement. 
Participants indicated that the assessment for placement either took place before 
classes started (n = 3) or was carried out in the first or first few classes (n = 3). 
The other six respondents did not provide an answer regarding when placement 
happened. As for communicating a decision to parents, most respondents (n - 9) 
indicated that parents were informed of their children's placement, either in a 
meeting or conversation (n - 7), or through a copy of the evaluation (n - 2). 
One participant did not specify how the parents were informed. One respondent 
stated that "(it) is information that pertains to the school only", and it would only 
be shared if parents demanded it (though it is not clear what "it" may refer to). 
The other two respondents did not specify how parents were informed about 
placement decisions. 

Results regarding placement procedures address the first research question in 
this study. Unsurprisingly, we find variation in approaches to placement among 
Brazilian Portuguese HL programs. Student placement may be done based on age 
alone, or may involve other elements, such as interviews with parents and/or 
with students, a type of test, a few classes, or a combination of elements (e.g. 
interview and test; age and survey filled by parents). When placement is based 
on more than a child's age, the process (interview, test, survey, class) may take 
from 10 minutes to four classes and may be carried out by a program director, a 
pedagogical coordinator, or a teacher. 

Q7 in the survey sought to address the second research question in this study. 
It required an answer, was open ended, and looked for information on assess- 
ment during the academic year: whether it was carried out, what instruments 
were used, what kind of feedback was provided to students and/or parents. Q7 
also requested examples of assessment and/or feedback, if possible. Every re- 
spondent answered the question, although most did not address all the points 
in the question. Most participants (n - 12) mentioned that assessment was ongo- 
ing and was done by means of in-class or homework activities, which provided 
the teacher with information about student development. Two respondents (in- 
cluding one who had mentioned reports) mentioned tests: "a type of exam" and 
"written and oral tests". As for feedback, four participants alluded to a report: 
three specified that the report was sent to parents, while one respondent wrote 
simply “a descriptive report”, without further details. Five respondents indicated 
that teachers and/or coordinators spoke with parents about their children's prog- 
ress. The answer provided by one participant did not shed light on assessment in- 
struments or feedback: "[a] meeting with moments of integration". Importantly, 
one of the answers that mentioned that assessment was done through in-class 
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activities also stated that the teacher and the coordinator analyze student perfor- 
mance, and "new strategies are implemented if students don't reach the learning 
goals" established for the activities. This points to formative assessment, since 
teaching strategies are adapted depending on how students do in the activities 
proposed. 

The results for Q7 address the second research question in this study: whether 
(and how) Brazilian Portuguese community-based HL schools assess learner 
progress during the academic term. For the most part, results of in-class activ- 
ities appear to provide teachers with the information they need about learner 
development during the term. In some cases, there may be more formal ways of 
assessing learner progress, even if the tests used are not considered to carry the 
kind of formality normally associated with them. One participant indicated that 
lesson plans may respond to students' needs as evidenced by in-class activities. 

Like Q7, Q8 also required an answer. This multiple-choice question addressed 
summative assessment, asking whether students were evaluated at the end of the 
academic term. The options were (a) yes; (b) no, because we assess and provide 
feedback during the term; (c) no, because groups move together regardless of 
results; and (d) other. Ten participants answered (a), six chose (b), one chose (c) 
and one responded (d) (The teacher evaluates students' development during the 
whole year"). Participants who answered (a) and (d) were asked to also answer 
Q9, which asked respondents to explain how assessment is carried out at the end 
of the academic term. However, one of the participants who answered (a) in Q8 
did not answer Q9. The results for Q9 show that, for the most part, assessment at 
the end of the term is not done formally: only three participants mention some 
kind of test. One respondent wrote the word "exam" in quotation marks, which 
suggests that s/he does not consider the end-of-semester exam to be the type of 
formal exam to which s/he may be used. Two participants mentioned that the 
children do a presentation at the end of the academic year. Another two referred 
to observing development through in-class activities, while one alluded to a “de- 
scriptive evaluation" of each student. Interestingly, two respondents indicated 
that classes generally do move together (even though they chose option (a) in 
O8, not option (c)), with possible exceptions of children skipping a level or being 
held back. 

The third research question that guided this study is addressed by the results 
of Q8 and Q9. We see that at least one program among those that participated 
in the survey chooses to move students together, regardless of possible achieve- 
ment (incidentally, the answer Q7 did not suggest that there was any form of 
assessment during the term either). In other cases, programs either carry out 


139 


Gláucia V. Silva 


some form of assessment (such as presentations or even tests) or rely on infor- 
mation gathered during the term only. The next section turns to a discussion of 
these results in light of the literature. It also presents suggestions of assessment 
approaches that can be utilized by Brazilian Portuguese community-based HL 
programs and possibly programs in other less commonly taught languages. 


6 Discussion and suggestions 


The data gathered reveal that it seems to be common for Brazilian Portuguese 
community-based programs to invite parents of new students for a conversa- 
tion, mostly to explain logistics and to have an idea about whether the child uses 
Portuguese, and if so, how much. However, other objectives were also revealed 
in the answers, suggesting that administrators and teachers may view the or- 
ganization as more than a language school. Raising parents' awareness of the 
importance of the Portuguese language for their children is an important goal 
that this conversation may serve (Boruchowski 2014), as revealed in the data. 
The relevance of bilingualism/multilingualism cannot be overstated; however, 
in the United States, many still see bilingualism as a problem rather than an 
asset. As Foster (1982: 342) puts it, "bilingualism is seen by many as evidence 
of insufficient assimilation? Due to this ideology and the “monolingual bias [...] 
that views bilingualism [...] as something that should be eliminated" (Block 2007: 
67), parents may be unaware that they need to use the Portuguese language at 
home if they want their children to learn it. As Lico (2015: 224) notes, the role 
of community-based schools is “not to make up for or ‘fix’ what is not done at 
home; after all, the basis of this process is to recognize and to value the [chil- 
dren's] heritage, of which the parents are the source" (my translation). Thus, 
some school administrators and teachers feel the need to explain to parents that 
their use of Portuguese at home is essential for their children's linguistic and 
cultural development. 

Besides the role of the family in maintaining and developing children's HL, the 
role of the school in the community may also be the topic of the conversation 
with parents, as mentioned by one of the participants. Community-based schools 
may organize activities around Brazilian traditions (Dias de Quadros 2017; Souza 
2017), providing the diasporic community with an opportunity to gather, meet, 
and celebrate their traditions. These schools may also teach Portuguese as a 
foreign language to adults and teach the majority language to speakers of Por- 
tuguese (Godoy & Litran 2017), as well as invite the community at large to discuss 
bilingualism and its advantages (Lira 2017). Thus, the role of community-based 
schools may go well beyond helping children maintain and develop their HL. 
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Although Brazilian Portuguese community-based programs may do much 
more than teach language, linguistic and cultural development is undoubtedly 
their main objective. As discussed in §2 and 83, placing students in HL classes 
is a challenge, be it in university-level courses or in community-based schools. 
Placement methods elicited by this study vary: while one-third of respondents 
stated that their schools place new students only according to age, many schools 
adopt more than one criterion to determine what class a new student should join. 
Aside from age, interviews and/or tests may be used to place students, as well as 
surveys that parents fill out. The assessment related to placement may be con- 
ducted by a teacher or by someone who fulfills another role, such as the program 
director or a pedagogical coordinator. 

Differences in placement procedures are to be expected, as evidenced by the lit- 
erature reviewed in $2. While age is a very important factor in grouping children, 
HL programs should also consider a child's linguistic and cultural skills, as some 
already do. If a school has enough students to warrant more than one class per 
age group, then even children as young as four years old can be placed according 
to their ability in Portuguese. Some suggestions regarding university-level place- 
ment exams can be useful for community-based HL programs as well. Fairclough 
(2012a) recommends that receptive, productive, and creative areas be measured. 
In the case of children, listening and speaking skills would be assessed; read- 
ing and writing may apply in the case of older children, to determine whether 
they have already developed some ability in those domains. However, it is im- 
portant to focus on language use, not exclusively on metalanguage (i.e., names 
of linguistic structures or grammatical terminology). Furthermore, children who 
learn Brazilian Portuguese as a HL are bilinguals and may display linguistic be- 
haviors that are common among that population, such as code-switching, which 
demonstrates bilingual competence (Carvalho 2012). However, it is important 
to keep in mind that a bilingual is not two monolinguals in one and does not 
develop identical strengths in both languages (Valdés 2001). Therefore, it is not 
realistic to assess HL learners as if they were monolingual speakers of Brazilian 
Portuguese; this fact needs to be considered in the development of placement 
tools. Instead, placement instruments should reflect the local linguistic context, 
as suggested by MacGregor-Mendoza (2012), so as to assess learners' abilities in 
their local circumstances. 

The instruments used for placement purposes should be developed by each 
program, taking into consideration the linguistic and cultural experiences of the 
group these programs serve (Beaudrie & Ducar 2012; MacGregor-Mendoza 2012; 
Vergara Wilson 2012; Son 2017), as well as the mission of the program (Fairclough 
2012a). There should also be ongoing development of assessment tools to respond 
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to learners' needs and to improve the placement instruments (Beaudrie & Ducar 
2012). Furthermore, the data gathered should inform the curriculum of the pro- 
gram and the syllabi for each class (Carreira 2012b; Ilieva & Clark-Gareca 2016). 
Most community-based HL programs may not have the means to implement elec- 
tronic placement tests, which would make data compiling easier (Fairclough et 
al. 2010), so it is important to take care to develop placement tools that do not 
make data gathering a cumbersome process. While programs should consider 
their own context in devising these tools, each program should not need to “rein- 
vent the wheel.” On the contrary: community-based schools should exchange 
best practices in order to find out if strategies adopted by other programs may 
be applicable to their own. Institutions such as universities and consulates may 
sponsor periodic events geared towards the exchange of best practices and invite 
representatives of community-based programs in their regions. 

Assessment of student progress during the academic term can also vary quite 
a bit among community-based schools, as attested in the literature. Some of the 
schools included in Bradunas & Topping's (1988) report tested their students reg- 
ularly, whereas others left it to the teachers to monitor pupils' progress, and 
others had informal types of assessment (such as spelling contests). The sur- 
vey conducted for the present study reveals that, today, Brazilian Portuguese 
community-based schools also adopt different strategies regarding assessment 
of progress during the academic term. Most participants in the survey stated 
that their schools assess student progress during the year, which is done with in- 
class or homework activities. However, there were no details provided regarding 
the types of activities that may elicit evidence of development. Two participants 
did mention tests but did not provide specific information about the structure of 
such tests. Only one participant mentioned that student performance is analyzed 
and that new strategies are adopted depending on whether learning goals were 
reached. This type of analysis suggests that at least some schools may adopt for- 
mative types of assessment that allow for instructors "to adapt their teaching so 
as to attend to the needs of all learners” (Carreira 2012a: 115). As Carreira (2012a) 
emphasizes, formative assessment helps instructors address issues of learner di- 
versity, which are undoubtedly present in any HL classroom. Even though the 
examples provided by Carreira are from a college-level class, some of the activi- 
ties may be used in community-based programs that meet only once a week. Exit 
cards can quickly provide information about the day's lesson. For example, chil- 
dren who can already write may be asked to list new words learned, or to form 
a sentence with the structure practiced, or to give feedback on a game. Younger 
children may be asked to draw words they have practiced, or to color a certain 
number of squares, or to use certain colors - always receiving instructions in 
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Portuguese. Children who can write may be asked to keep journals, which they 
may share with the teacher either in class or electronically. These may be read- 
ing journals, as suggested by Carreira (2012a), or simply journals about what was 
interesting (or not) in a lesson. The teacher can then identify whether students 
perceive a given activity as effective, whether they can control linguistic struc- 
tures that have been studied and/or whether they have grasped a certain cultural 
concept. Lessons would then be tailored to the needs of the learners as expressed 
in such assessment tools. This process results in differentiated teaching and learn- 
ing, which, as Carreira (2012a) and Beaudrie (2016) note, is ideal for HL learners. 
It is also important to keep in mind that assessment should also be differentiated 
and children should be evaluated in relation to their own achievement (Douglas 
2005), not by comparison to monolingual norms. 

With respect to summative assessment, at least one respondent mentioned 
that students move together as a group and no formal end-of-term assessment is 
carried out. Other answers indicate, however, that some kind of assessment takes 
place at the end of the academic term in some schools. Nevertheless, end-of-term 
assessment is mostly done informally, not unlike what was reported regarding 
assessment during the term. Even when there is a test, little formality seems to 
be attached to it, as suggested by the use of quotation marks around the word 
"exam" by one of the participants. This informality is not a negative aspect: for- 
mal evaluations would suggest to children that the HL program is just like regular 
school, an idea that is certain to demotivate students. Given that student recruit- 
ment is one of the challenges faced by these programs (Liu et al. 2011), schools 
need to do what they can to keep students motivated so they will remain in the 
program. 

Presentations by students, which was mentioned by several respondents, may 
constitute a formal type of summative assessment. At the end of the academic 
term, several Brazilian Portuguese community-based programs invite parents 
to a celebration that includes such presentations. This type of activity may be 
characterized as project-based learning if students are responsible for choosing 
a topic, researching it and putting the presentation together with suggestions 
and help from the teacher. Projects should be an opportunity for learners to de- 
velop different linguistic and cultural skills. Young children can also be engaged 
in projects: teachers may, for example, have learners work on linguistic and cul- 
tural elements of a given song during the semester, and present the song at the 
end. Older students might produce a video on the topic of their choice and/or 
in consultation with the teacher. Other possibilities for projects that learners 
can work on during the term include posters, a class magazine, and an art show 
(paintings, drawings, photos, etc.), among other possibilities that would revolve 
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around the heritage language and culture. Project-based learning may increase 
motivation and help students learn (Blumenfeld et al. 1991). Though possibly var- 
ied in nature, these projects would culminate in a product that can not only be 
shown to parents, but may also serve as a springboard for the following year's 
curriculum for each class, even if the group moves together regardless of individ- 
ual performance. During the project, teachers may take note of aspects that need 
to be reinforced and/or revisited as well as aspects that have been acquired and 
may no longer need special attention. Furthermore, projects may give learners 
an opportunity to engage in community-based activities while integrating their 
linguistic and cultural abilities (Ilieva 2007). Teachers and pedagogical coordina- 
tors may find ideas on project-based learning, for example, in Beckett & Miller 
(2006) and in Vaca Torres & Gómez Rodrígues (2017), although such ideas would 
need to be adapted to each community-based program context. 

Although each program must to be tailored to its own context, exchanges 
of best practices can provide new avenues to be explored. Events such as 
the Annual Community-Based Heritage Language Schools Conference, held 
by the Coalition of Community-Based Heritage Language Schools (http:// 
heritagelanguageschools.org/coalition), gives HL educators an opportunity to 
listen to experts and to discuss relevant issues. However, many Brazilian Por- 
tuguese HL teachers cannot attend the annual conference in Washington, DC. 
Therefore, consulates and universities that have Portuguese language programs 
may sponsor events that would be more easily attended by HL educators in a par- 
ticular region. Like the annual conference in DC, these local events would also 
serve to keep educators current on research that may inform their assessment 
practices (Ilieva & Clark-Gareca 2016). Another possibility would be to create 
an online portal with resources for educators, including a forum. These teachers 
would likely work in similar contexts, which would possibly allow them to more 
easily adapt strategies and approaches that have worked well in a given program. 


7 Final remarks 


This study has contributed to discussions of assessment by shedding light on 
what is practiced by Brazilian Portuguese community-based HL programs. Lim- 
itations of the study include the small number of participants and the lack of 
details about the forms of assessment practiced by these programs. The fact that 
respondents completed the survey anonymously, which was done in order not to 
discourage participation did not allow for follow up questions with respondents 
which might have clarified what their assessment practices consist of. Future re- 
search should include interviews with educators in order to elicit more details 
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about assessment procedures, including the content of the interviews with par- 
ents and with students, as well as the content of tests, how they are adminis- 
tered, and at what point in the school year. Conversations with educators may 
also elicit their views on types of assessment and what they believe may be more 
helpful to learners in their particular context. 

The suggestions offered here are only a starting point. Heritage language edu- 
cators have proven to be very creative and capable of achieving a lot with limited 
resources. Given a chance to learn about what other programs do and exchange 
resources, these teachers and administrators may be able to help their pupils 
develop their HL abilities more effectively. 


Appendix A 


Survey distributed to HL educators in community-based programs (translated 
from Brazilian Portuguese). The author wishes to thank Ana Lucia Lico for her 
input on a previous version of this survey. 


1. Before classes begin, does anyone in your school talk to parents/guardians 
of new students? 


a. Yes (please answer question 2) 
b. No (please skip to question 3) 
2. The goal of the talk with parents/guardians before the beginning of classes 
is: 
3. At your school, new students are placed in classes: 
a. according to age only. (Please skip to question 7) 


b. according to the result of an assessment and/or interview. (Please 
answer questions 4-6) 


c. according to age and assessment/interview (Please answer questions 
4-6) 
d. Other 
4. If you answered (b), (c) or “Other” in question 3, please describe the in- 


struments used in the assessment to place new students (e.g., interviews, 
checklists, written evaluation, etc.). 
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5. If you answered (b), (c) or "Other" in question 3, how long (on average) 
does it take to assess new students? Who carries out the assessment De, 
what position does this person/do these people occupy)? 


6. If you answered (b), (c) or "Other" in question 3, when is the assessment 
of new students done? Is the family informed of the assessment result? If 
so, how? 


7. During the academic term, is students' linguistic/cultural development as- 
sessed? If so, how is this assessment carried out (e.g., with activities done in 
class or at home, with a checklist, etc.)? What kind of feedback is provided 
to students and/or parents/guardians (e.g., grade, progress report, etc.)? If 
you can, please describe examples of assessment and/or feedback. 


8. At the end of the academic term (trimester, semester, year or any period 
adopted at the institution), is learner development assessed? 


a. Yes (please answer question 9). 


b. No, because we assess and provide feedback during the academic 
term. 


c. No, because classes move together, regardless of results. 


d. Other 


9. If you answered “Yes” or “Other” in question 8, please explain how the 
assessment at the end of the term is carried out and whether it takes into 
account any assessment done at the beginning of the term. 
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This study examines the role of two indigenous languages in higher education 
in the Amazon of Peru. It looks at efforts to implement Kukama and Kichwa as 
key components in the teacher training model developed by the Programa de For- 
mación de Maestros Bilingües de la Amazonía Peruana (henceforth FORMABIAP 
for its initials in Spanish). At present, Kukama and Kichwa are at different points 
of UNESCO’s endangerment scale. Teaching them in higher education is part of a 
more comprehensive commitment to build culturally and linguistically appropriate 
education for Amazonian indigenous groups. This chapter documents several com- 
ponents of the FORMABIAP project. We look at a sample of eight FORMABIAP's 
alumni, five Kukamas and three Kichwas, to investigate and reflect on the overall 
outcomes of their learning process. In addition, we survey the profiles of the in- 
structors, the structure of the language classes, and their communities of practice. 
An important finding of this study is that endangered languages can be relearned 
by heritage speakers in a combination of naturalistic and well-structured instruc- 
tional settings. We conclude that the assessment of these relearning processes 
needs to be holistic, going far beyond linguistic proficiency. In the Amazonian 
context, at the center of it all are language attitudes, sense of cultural membership, 
and the learners' positioning with respect to the aspirations of their communities 
and indigenous organizations. Although the general teaching components can be 
in fact planned for several ethnic groups, the implementation of the proposals and 
the evaluation of the outcomes must be done individually and by the indigenous 
group to capture the uniqueness of each sociolinguistic context. 
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1 Introduction 


The present study deals with relearning processes of endangered Amazonian 
languages in the context of FORMABIAP (more details at www.formabiap.org). 
The Amazon Basin is characterized as one of the most culturally and linguisti- 
cally diverse areas in the world, with about 300 languages belonging to twenty 
or so language families, plus dozens of genetic isolates (Queixalós 2009). Nev- 
ertheless, Amazonian languages are, for the most part, both poorly documented 
and highly endangered. The majority of these languages are spoken by relatively 
small speech communities, compared to Spanish or Portuguese, the two major 
languages with which they coexist in highly asymmetrical relationships. 

This chapter focuses on two Amazonian languages: Kukama-Kukamiria 
(henceforth Kukama) and Kichwa. Their territories are located in the Loreto re- 
gion of Peru. Loreto hosts an extreme linguistic diversity, which includes about 
23 languages (Solís Fonseca 2009; Queixalós 2009). However, the speakers of 
these languages represent only a small percentage of the total population in the 
region. According to census data from Peru's Instituto Nacional de Estadística e 
Informática (INEI 2017), 9.8% of the population in Loreto self-identify as a mem- 
ber of an indigenous group, yet only 6.4% of them declare to have learned to 
speak in an indigenous language. These statistics illustrate the increasing social 
pressure to learn, and ultimately shift to, Spanish. 

Languages such as Kukama and Kichwa continue to lose ground in daily 
use. By including indigenous languages as part of a teaching training program, 
FORMABIAP aims to counter the progression of rampant language loss. How- 
ever, data regarding the outcomes of relearning these ancestral languages by 
heritage speakers do not exist. This is particularly important given that these 
speakers are, or will eventually be, in charge of teaching these languages in their 
communities. It is often mentioned that due to their limited command in the 
ancestral languages, heritage speakers lack the ability to teach these languages 
(cf. López & García 2016: 127). However, no study has ever attempted to explore 
how much heritage speakers have actually achieved in the process of relearning 
their languages. Importantly, in the context explored here, this process does not 
end at their graduation from FORMABIAP, but continues as they teach the lan- 
guages to children and engage with other speakers in the linguistic and cultural 
reanimation of their communities. 

This document aims to start a conversation regarding both heritage language 
teaching and assessment in the Amazonian context. We look at original empir- 
ical data collected from eight heritage speakers and offer the first attempt to 
understand this relearning process in higher education. An additional aim of 
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the paper is to identify patterns of use, as well as areas of improvement, in the 
speech of heritage speakers in order to contribute to curricula development. An 
important finding of this study is that all the participants exhibit various degrees 
of language expertise. Thus, indigenous heritage languages can be relearned in 
a combination of naturalistic and well-structured instructional settings, as the 
outcomes of the multifaceted approach implemented by FORMABIAP are both 
tangible and substantial. 


2 Local context 


Any formulation of pedagogical proposals requires a prior characterization of 
the sociocultural and linguistic contexts of the communities and of the students 
themselves. In this section, we set the background for the study. 


2.4 Kukama 


The Kukamas live in small villages spread along several Amazonian rivers. Ac- 
cording to the parameters provided by UNESCO (Moseley 2010), the Kukama 
language is severely to critically endangered. The total number of Kukamas is 
estimated at 20,000. However, the INEI 2017 census indicates that only 1,185 in- 
dividuals have learned to speak this ancestral language, and 82.6% of them live 
in the Loreto region.! Most of the remaining fluent speakers are elders, and cer- 
tainly none of them are monolingual in Kukama (Vallejos 2016b). Children are 
no longer learning the language, as natural processes of language transmission 
have been interrupted more than five decades ago. Over the years, a growing 
concern with respect to the vitality of the language has become evident within 
the speech community itself, which has resulted in a number of revitalization ini- 
tiatives. These efforts are being implemented mainly through formal education. 
As a result, it is possible to find different types of speakers of Kukama, in the 
sense of Grinevald & Bert (2011), including traditional speakers, latent speakers, 
neo-speakers, and rememberers (Vallejos 2016b). 

One of Kukama's most salient typological features is a morphological distinc- 
tion between male and female speech in several grammatical categories. Major 
grammatical categories like person, number, tense, and modality are conveyed by 
positionally-fixed clitics. Five tense clitics encode three degrees of distance into 
the past and two into the future. There is a four-way epistemic modal system 


‘According to (INEI 2017), 9.7% of the 1185 Kukamas live in Lima/Callao, 3.8% in Ucayali, and 
the remaining 4% are spread throughout the country. 
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encoding via second position clitics. In Kukama there is neither case marking 
nor affixal indexation of core participants to express grammatical relations. In 
main clauses, SVO is the pragmatically unmarked constituent order. While OSV 
is employed with salient objects, SOV is only possible if the verb is marked by 
progressive aspect. Oblique phrases are marked by postposition, and clauses are 
linked by dedicated adverbial subordinators. Clause nominalization is a central 
subordination strategy, particularly in relativization. 


2.2 Kichwa 


The Kichwas live in the basins of the Napo, Putumayo, Pastaza and Tigre rivers, 
in the Loreto region in Peru. Those who live in the basins of the Napo and Putu- 
mayo rivers call themselves Napu Runas and those who live in the Pastaza and 
Tigre rivers call themselves Ingas. They are also located in the San Martín re- 
gion, known as Lamistas, and in Madre de Dios region, known as Santarrosinos. 
According to the last census, 99% of the Kichwa live in Loreto, and only 1% live 
in other regions. The Kichwa speakers who live along the Napo River are the 
descendants of Ecuadorian Kichwa populations called Quijos (Mayor & Bodmer 
2009). The Kichwa themselves assert that their parents or grandparents came 
from Ecuador, and a group of them migrated from the Napo River to Madre de 
Dios during the time of rubber extraction. Although the Ministry of Education of 
Peru mentions that Kichwa is a variety of the Quechua language, in the last na- 
tional census (INEI 2017), Kichwa is listed as a different language than Quechua. 
According to this census, 5,751 declared that Kichwa is the language in which 
they learned to speak. Although the number of Kichwa speakers in Peru seems 
to be very small, their linguistic kinship with the Quechua-speaking population 
(3,799,780 according to INEI 2017) relativizes this situation. Kichwa exists in a 
range of sociolinguistic situations, from communities where this language is the 
main means of communication among all generations, to communities where 
Spanish has almost completely replaced Kichwa (see 82.4). 

The Kichwa varieties are part of the Quechua linguistic family. There are, how- 
ever, important cultural and linguistic differences between Kichwa and Quechua. 
From a cultural perspective, due to their geographical location in the Peruvian 
Amazon, the Kichwas' worldview is closer to other Amazonian peoples, includ- 
ing the conception of territory as a fundamental element of life. Perhaps the most 
salient phonological difference between Kichwa and Quechua is that Quechua 
makes a distinction between post velar /q/ and velar /k/, Kichwa does not make 
this distinction. Regarding its typological profile, Kichwa is characterized as an 
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agglutinating language with suffixal morphology. The preferential order of con- 
stituents is SOV, although SVO, OVS are also possible. Grammatical relations 
are encoded through case marking and verb indexation. Finite verbs take TAM 
suffixes. Adnominal possession is expresses via a genitive marker suffixed to the 
possessor. 


2.3 Speaker types in endangered language contexts 


Amazonian languages exhibit different degrees of endangerment. Speech com- 
munities of endangered languages typically comprise several types of speakers 
who show variance in competence. Grinevald & Bert (2011), building on Dorian 
(1980), propose four clusters of variables to identify types of speakers: (i) lan- 
guage competence cluster (level of acquisition attained and degree of individual 
loss), (ii) sociolinguistic cluster (vitality of language at time of acquisition and 
the age of the speaker at the time of exposure to the language), (iii) performance 
cluster (level of use of the language and the attitudes towards the language), (iv) 
self-evaluation of language skills (which can range from under-evaluation, in- 
security and self-denial to over evaluation). The implementation of these four 
parameters gives the following types of speakers (Table 1). 

FORMABIAP trains neo-speakers, who, if we highlight their cultural ties to 
the Kukama and Kichwa ethnic groups, are considered heritage speakers. These 
students enter the program with very limited knowledge of their ancestral lan- 
guages (more details in §5 and 86). 


2.4 Sociolinguistic contexts 


Concurrent with different speaker types, Amazonian languages are spoken in 
a variety of sociolinguistic contexts. Considering the social dynamics and the 
actual use of the indigenous languages and Spanish, it is possible to identify a 
wide range of complex scenarios. For example, if we take the Kichwa villages 
along the Napo River in Peru as a reference point, we can identify a continuum in 
terms of the vitality of the Kichwa language. In the High Napo River (Alto Napo), 
an area close to the Peru-Ecuador border, there are villages such as Chingana 
and Humandi where children are learning Kichwa as a first language. In those 
villages, Kichwa is still the dominant language among all the generations, and 
very few know any Spanish. 

In the High Napo region, but further south from the Peru-Ecuador border, 
there are villages such as Angoteros and Campo Serio where bilingualism in 
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Table 1: Typology of speakers of endangered languages (Vallejos 2016b: 


147) 


Fluent speakers 


Latent-speakers 


Rememberers 


Former speakers 


Last speaker 


Neo-speakers 


Also called traditional speakers, they have acquired the 
language fully and are able to engage in spontaneous 
conversations. Such speakers are able to provide 
narratives with very minimal use of borrowings. 


They demonstrate receptive skills but with varying 
degrees of production. They have not had regular 
conversation partners and display modified patterns that 
can be considered mistakes by fluent speakers. 


This category includes speakers with advanced level of 
attrition often due to traumatic circumstances. They have 
passive knowledge and very limited productive skills, 
which usually includes frozen expressions. They may 
have regained or reacquired some partial use and could be 
at first inhibited to get involved in revitalization efforts. 


They are also called ghost speakers, those who deny any 
knowledge of the language. This denial is a consequence 
of strong negative attitudes associated with speaking a 
language that is usually overpowered by a national 
language. 


This may be a socio-political category; that is, public and 
social role assigned by a community, or self-attributed. 


They are the product of revitalization initiatives. They 
have positive attitudes towards the language and make 
conscious efforts to learn it. They can achieve a range of 
proficiency levels and show signs of language 
obsolescence. 


Spanish and Kichwa is gaining ground among male adults. In those villages, Span- 
ish is used in rather limited contexts; note that by the time children start school- 


ing around the age of five, they are predominantly monolinguals in Kichwa. Even 
further south in the High Napo region, there are villages, such as Ingano Llacta, 
where bilingualism in Kichwa and Spanish has been extended to the entire pop- 
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ulation. In these villages, every generation is bilingual. As a result, children are 
currently learning both languages from birth. 

In the Mid Napo River (Medio Napo), in villages like Copal Urcu, San Carlos, 
Rumitumi, Diamante Azul, and San Jorge, the majority of the children and the 
youth already speak Spanish as a first, and mostly only, language. However, these 
generations are still exposed to Kichwa during their interactions with their par- 
ents and grandparents. The generations of adults and elders communicate among 
themselves in Kichwa, but they tend to address their children in Spanish. As a 
result, most of the children and the youth can understand Kichwa, but show very 
limited production in this language. 

In the villages located along the Low Napo River (Bajo Napo), the situation is 
more pressing. In villages such as Lagartococha, Puca Barranca, and San Juan 
de Yanayacu, Kichwa has been displaced almost completely. Although it is still 
spoken by elders, and they may use it in sporadic situations among themselves, 
Spanish is already the only language of daily communication for all generations. 
Beyond the Napo River, the Kichwa villages located along the Pastaza River and 
the Tigre River also show displacement of Kichwa in favor of Spanish, mainly 
among children and the younger generation. 

As for the Kukama villages, most of them have experienced language shift 
in favor of Spanish, similar to the last scenario discussed for Kichwa. Nowadays, 
Kukama is only known by elders, and they use it in very restricted contexts. How- 
ever, there seems to be a difference between the Kukamas and the Kichwas. The 
Kukamas are more aware of the loss of their language, and in the last decade they 
have started to express their concerns more openly. In some regions, there are 
ongoing movements of cultural re-appropriation to reconnect with their roots, 
and relearning their heritage language is part of this movement. 

Note that the possibilities for re-learning the indigenous language decreases 
from one scenario to another. Taking Kichwa, again, as a reference, it is possible 
to say that natural language transmission is almost guaranteed in the first sce- 
nario. The second and third scenarios result in different degrees of bilingualism; 
these new language practices tend to go hand in hand with negative attitudes 
towards the indigenous language. In cases like this, children learning the indige- 
nous language as a first language is no longer guaranteed. In the fourth scenario, 
children are not acquiring the indigenous language as a first language, but the 
context is favorable for re-learning it with heritage language methodologies. In 
the fifth scenario, the functionality of the indigenous language is extremely lim- 
ited, and so is the possibility of learning the indigenous language without a well- 
thought-out revitalization effort. 
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Notably, one of the many challenges FORMABIAP faces to teach indigenous 
languages is that its students come from all these different scenarios. 


3 The FORMABIAP Program 


FORMABIAP began its activities in 1988, as a result of an agreement between 
the Ministry of Education of Peru, the Corporación Departamental de Desarrollo 
de Loreto (CORDELOR), the Asociación Interétnica de la Selva Peruana (AIDESEP), 
and the Italian NGO Terra Nuova. FORMABIAP was created as a program to train 
indigenous teachers in intercultural bilingual education (IBE) within the frame- 
work of a Pedagogical Higher Education Institute, based in the city of Iquitos. 
From its inception, FORMABIAP was a pioneer model for a genuine collabora- 
tion between the government and a national indigenous organization. The role 
of indigenous specialists and scholars in the teacher training process, as well as 
the participation of community members in the development of the curricula for 
elementary education are some of the key components of its success. In its 32 
years of work, FORMABIAP has trained 1,213 indigenous teachers from 16 Ama- 
zonian ethnic groups, who have taught an estimated 363,900 Amazonian children 
(Trapnell Forero et al. 2018). 

FORMABIAP considers that languages and education must be approached 
from the specific social contexts in which the project operates, and from a politi- 
cal and historical vision that allows its students to understand how the processes 
of colonial domination have influenced the current situation of the indigenous 
languages (Trapnell Forero et al. 2018: 38). At the beginning of the FORMABIAP 
project, most students had an indigenous language as their L1, with the excep- 
tion of the Kukamas who were mostly monolingual in Spanish. Over the years, 
the sociolinguistic landscape has become more heterogeneous and complex to 
address. On the one hand, there is now a greater number of students with seri- 
ous limitations in oral Spanish. On the other hand, the number of students that 
have Spanish as a first language has increased. 


3.1 Why heritage language instruction in FORMABIAP 


A second language is any language an individual learns in addition to their first 
language, and no previous knowledge of this language is implied. In contrast, a 
heritage language entails certain exposure to the target language during child- 
hood, as well as a cultural connection to the language through family, ancestors, 
community, or country of origin. In this view, a heritage language can be an 
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indigenous language that underwent displacement (i.e. Kukama and Kichwa in 
Peru) or an immigrant language (i.e. Spanish in the United States or Turkish in 
Germany). In a narrow definition, heritage learners are bilinguals, but the lan- 
guage they learned in childhood at home is no longer their dominant language; 
instead, they are dominant in the hegemonic language of the society in which 
they live. In a broad definition, heritage learners have had at least some input 
during childhood but did not grow up with this language as a means of commu- 
nication (Polinsky & Kagan 2007; Rothman 2009). As a result, heritage language 
learners can display widely diverse levels of proficiency (Valdés 1989, 2005). In 
the cases discussed in this article, we adopt a broad definition of heritage learn- 
ers. 

Heritage languages, as all languages, are surrounded by ideologies, from is- 
sues of identity and group membership, to views of language as a commodity 
that question the value of an ancestral language in current times. Other com- 
mon ideologies relate to who are the "true owners" of a given language, who 
should have the ultimate say on how the “real language” should sound like, and 
diverse perceptions regarding language variation and change (see, for instance, 
Lopez Odango 2015). Thus, in multilingual settings such as the Amazon, the de- 
velopment of intercultural communication competence needs to be stressed. This 
development involves self-reflection concerning language and culture, and it in- 
volves attitudinal changes toward one's own and others' cultures and languages. 

The fact that heritage learners bring some linguistic knowledge from child- 
hood has opened important avenues in second language acquisition research, 
particularly on the role of age, input, and implicit versus explicit knowledge 
(Valdés 2005). For example, heritage speakers seem to have an advantage over 
L2 learners not only with regards to phonology, but also in some aspects of mor- 
phology and syntax (Montrul 2008). Issues related to linguistic mechanisms and 
the types of patterns that emerge in language loss and revitalization contexts 
(Hinton 2001) are also important theoretical questions for language change. The 
impact of the results of these new lines of research in teaching methodologies 
continues to be explored (Parodi 2008, Potowski 2018). 

Motivation is critical to language learning, but particularly so in heritage lan- 
guage learning. If cultural heritage is a motivating factor to learn a language, it 
can promote learner autonomy to continue the learning process beyond the for- 
mal settings. This is critical in endangered language contexts where the target 
language is no longer used in daily communication. For example, leaners of Ku- 
kama and Kichwa have to make an effort to build a community of practice in 
their villages. 
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Heritage learners can also vary with respect to forms of exposure and age of ac- 
quisition (naturalistic process during childhood, formal instructional settings as 
adults, revitalization contexts guided by elders and activists, etc.), communities 
of practice, and amount of access to input in the target language. The heritage 
speakers of Kichwa and Kukama who participated in this study were exposed 
to their ancestral languages to various degrees during childhood; however, all of 
the participants manifest a strong cultural connection and a sense of membership 
to their respective ethnic groups. 


3.2 Profile of learners 


Three decades ago, aspiring Intercultural Bilingual Education (IBE) teachers were 
older than the average high school graduates in Peru, and many had not com- 
pleted a secondary education. Most of the students at the time predominantly 
spoke an indigenous language as their first language, with the exception of the 
Kukamas. In more recent years, however, the completion of a high school educa- 
tion became a prerequisite to enter FORMABIAP. By going through the complete 
educational system (i.e. kindergarten, primary, and secondary), in many cases 
outside their villages, these students have acquired greater proficiency in Spanish 
than those that entered FORMABIAP 30 years ago. Nevertheless, an unintended 
consequence is that these new generations have had fewer opportunities to learn 
the cultural knowledge of their people and their respective indigenous language. 
As a result, the most recent cohorts of students who come to FORMABIAP show 
less command of their indigenous languages. That is, the linguistic profile that 
used to be associated with the Kukamas has now been extended to other indige- 
nous groups, such as the Awajun, Shawi and Kichwa. Note, though, that the 
Kukamas and Kichwas come with a very limited command of their heritage lan- 
guages not only because of the formal schooling, but also because the generation 
of grandparents who speak those languages is declining rapidly. 

Under these conditions, the relearning of an indigenous language by the future 
teachers is even more challenging. But even for students who have an indigenous 
language as their L1, having had less exposure to that language in the community 
life entails that it needs to be taught and expanded at the oral and written levels. 
In several cases, the indigenous language was generally used only in primary 
education (K-5), and then its use was interrupted at the secondary level. In the 
Amazon of Peru, secondary education is developed almost exclusively in Spanish. 
It is then imperative that the new cohorts that join FORMABIAP strengthen their 
competence in their indigenous languages, as well as their cultural traditions. 
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However, the demand for learning the indigenous languages arises not only 
because of FORMABIAP’s institutional mission, but because there are now na- 
tional IBE policies that demand communicative competence of the indigenous 
languages in the schools that provide an intercultural bilingual education (Min- 
isterio de Educación del Perú 2016). In addition, according to the new official 
policies, teachers working in communities with heritage indigenous languages 
must implement cultural and linguistic revitalization (Ministerio de Educación 
del Perú 2016). In those communities, children have access to very few oppor- 
tunities to listen to the indigenous language because it is spoken only by older 
people in very restricted contexts. Thus, given that teachers have to teach these 
heritage languages to the children ofthese schools, the indigenous language must 
be relearned as part of their teacher training in FORMABIAP. 


3.3 Profile of instructors 


FORMABIAP hires language and culture specialists, who are fluent elder speak- 
ers. They come with their partners to live in Zungarococha, together with the 
students. Because of this configuration, these elders are mentors and make them- 
selves available to the students almost at all times and are a crucial resource on 
every aspect of their training. 

Second, the instructors of the indigenous languages are community members 
with training in language teaching methodologies. The instructors are in charge 
of preparing and implementing the lesson plans with the input from the elder spe- 
cialists. In addition, in some cases, there is also a linguist who collaborates with 
the specialist and the instructor. The role of the linguist in FORMABIAP is more 
focused on developing awareness about the structures of the language and guide 
the teaching process. They participate in the development of teaching materials, 
the incorporation of new genres and discourse practices into the classroom, and 
overall literacy development issues. 

The Kukama and Kichwa participants of this study had an elder specialist and 
one or two instructors. Sporadically, the cohort also included a linguist in charge 
of the grammatical study of the indigenous language. Within the Kichwa group, 
there were also students who were fluent in Kichwa in the same cohort. For in- 
stance, this provided participant kicH-3 with opportunities for practice the lan- 
guage with his peers. 

Beyond this formal training in FORMABIAP, heritage learners have the oppor- 
tunity to further develop their linguistic skills during their professional practices 
in the villages. These are important periods in which heritage learners immerse 
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themselves with other speakers of the languages, and the confrontation with 
their own communicative skills is unavoidable. 


3.4 Language classes 


Six months per year, during five years, FORMABIAP students from different eth- 
nic groups come to live in Zungarococha, a sort of academic town located away 
from the Iquitos city center. During this time period, FORMABIAP tries to guar- 
antee that the students have different types of support to relearn their heritage 
languages. The teacher training curriculum has always considered a space for 
formal classes and hands-on workshops around the indigenous languages during 
their five years of study. The classes and workshops are conducted on average 
two hours a week, during nine semesters. For those students that do not need 
to relearn the indigenous languages, the workshop is aimed at the development 
of new discourse practices, literacy development and reflection on the grammar 
of the language. For heritage speakers, such as the Kukamas, these spaces are 
designed to relearn the indigenous language with the help of an instructor, a 
specialist, and possibly a linguist. 

However, indigenous languages in FORMABIAP are not reduced to specific 
classes. They have a fundamental role in several other curricular components. 
For example, there is an umbrella educational project planned for each year of 
the training that is implemented by each indigenous group, rather than by aca- 
demic level. Past projects include: technologies of house building, natural dye 
techniques, practices of traditional healing, indigenous food and diets, etc. Under 
these projects, topics from different areas (such as mathematics, social studies, 
ecology, communication, pedagogy) are developed through integrated activities. 
The indigenous languages are the language of communication during all those 
activities. Thus, these spaces constitute additional opportunities of exposure to 
the languages for heritage learners. However, it is also important to underscore 
that several students show high motivation to learn the language and so con- 
stantly seek to create new support mechanisms for their learning. For example, 
taking advantage of the technology, most of them now have a dictionary and/or 
a translator on their smartphones. 

To monitor the progress of the students, FORMABIAP administers a diagnostic 
test to every student at the beginning of the five-year program, multiple assess- 
ment strategies throughout the nine semesters, and, in some cases, an achieve- 
ment final test with written and spoken components. It is important to consider 
that, according to FORMABIAP’s guiding rules, heritage speakers need to show 
systematic progress for their scholarships to be renewed. In fact, some students 
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have been removed from the program given lack of progress in this area. The 
discussion of these details is beyond the scope of this article. 

Having set our framework and the background, in the next section we intro- 
duce the empirical methods employed to measure proficiency in a sample of Ku- 
kama and Kichwa alumni. 


4 Assessment: approach and instruments 


In general, heritage languages are also less commonly taught languages, or are 
only taught in non-mainstream environments. In the cases of Amazonian lan- 
guages, few culturally appropriate materials for higher education exist, and set- 
ting baselines and benchmarks to measure proficiency in heritage speakers is 
still an area in need of attention. In addition, there is controversy whether the 
proficiency guidelines employed to assess second language learners is appropri- 
ate for heritage language abilities (Valdés 1989, Martin et al. 2013). Assessment of 
attained proficiency among heritage learners is essential for understanding the 
characteristics of their speech. It is crucial to identify areas of strength and error 
patterns in order to inform the curricular needs of instructional programs. Above 
all, it is important to understand heritage students’ motivation to learn languages 
that "lack" prestige and functionality in the eyes of the dominant society. 

A basic assumption here is that language proficiency is a continuum.? We fol- 
low an Integrated Performance Assessment approach to survey the performance 
of individual students and determine an overall, “big picture" view of their prog- 
ress (ACTFL 2012). We employ Can-Do Statements, which require learners to 
show what they know and can do, to demonstrate their language proficiency. 
Can-Do Statements reflect the continuum of growth in communication skills 
through different levels (Moeller & Yu 2015). Our goal was to examine the par- 
ticipants' ability to use culturally appropriate language, as judge by language 
consultants, to communicate spontaneously in non-rehearsed contexts. But en- 
couraging heritage speakers to produce spontaneous speech, or even eliciting 
narrative using stimuli, can be difficult given the surrounding social pressures 
and ideologies that can derive in linguistic insecurities (see, for instance, Silva- 
Corvalán 1994). In order to collect empirically based data, we provided learners 
with opportunities to use their heritage language in authentic, real-world situa- 
tions. We used an authentic video, picture cards, and a printed questionnaire. 


? According to the American Council on the Teaching of Foreign Languages Guidelines (ACTFL 
2012), the continuum consists of four major levels: novice, intermediate, advanced, and supe- 
rior. These major levels are further subdivided in eleven levels. The ACTFL Guidelines are 
intended to be used for holistic assessment and have instructional implications. 
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4.1 Video 


Videos were used for comprehension tasks. For Kukama, we selected a culturally 
relevant video of a procedural text collected within the context of the Kukama- 
Kukamiria Language Documentation Project (Vallejos 2014). It shows a 65-year- 
old woman explaining how to make a hand fan with a palm tree leaf. Only the 
first 10 minutes of a 17-minute video were selected. In this excerpt, the speaker 
introduces the materials and tools to be used, and then proceeds to describe a 
sequence of steps to make a fan as she weaves one. This video is particularly 
useful because of the pace of the speech as the speaker is carefully explaining 
the process. 

The participants watched the video twice. In the first pass, they completed 
a word recognition task. They wrote down all the words and expressions they 
could identify as the video was playing. In the second pass, they focused on both 
main ideas and supporting details and captured them in phrases and complete 
sentences. The second pass was also an opportunity to check and augment their 
word lists. 


4.2 Picture cards 


Picture cards were employed for production tasks. Two sets of picture cards that 
portray Amazonian scenes were selected as visual stimuli to elicit guided sto- 
ries. These cards are part of the series Cuentos en Tarjetas created by Amías et 
al. (2003), from FORMABIAP. The first set consists of cards that portray scenes 
about a dog that goes hunting with its owner in the jungle (see Figure 1). The 
second set consists of cards about three armadillos who go out to collect wild 
seeds and, while doing so, fall into a trap. 

The participants organized the cards in the order of their preference and then 
proceeded to create a story. These stories were recorded to allow qualitative and 
quantitative analyses, including speech rate. These speech samples are rich in 
objectively recognizable linguistic features in the areas of phonetics, phonology, 
morphology, syntax, discourse, and lexicon. It is important to note, however, that 
this procedure elicits samples of what speakers can do and help us identify areas 
of improvement, but it is not necessarily useful for discovering areas that speak- 
ers do not know yet. In the future, we may need to include other tasks to capture 
what advanced learners cannot do and need focused help with. 
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Figure 1: Example of a set of picture cards (Amías et al. 2003) 


4.3 Questionnaire 


We created a questionnaire to collect biographical information to determine what 
social and cultural factors influence their attitudes, motivations, and linguistic 
choices (cf. Alarcón 2010). It includes 32 items in total. The political and affec- 
tive issues surrounding heritage speakers came to light in these questionnaires. 
The first portion elicits information regarding their exposure to their ancestral 
languages during childhood, their motivations to become bilingual teachers, and 
their knowledge of their ancestral language before coming to FORMABIAP. In 
the second part of the questionnaire we collected information regarding lan- 
guage behaviors, attitudes towards dialectal and generational variation, and self- 
assessments of their heritage language abilities. Data from the questionnaire al- 
lows the examination of potential correlations between self-reported proficiency 
level, and speech rate, word recognition, and the use of specific grammatical pat- 
terns. 

In the next section, we present preliminary findings on linguistic correlates 
of proficiency in Kukama and Kichwa as heritage languages, based on data from 
the questionnaires, as well as perception and production tasks. 


5 Results: Kukama 


This study looks at five Kukamas. They are all heritage speakers that entered the 
program with very limited knowledge of their ancestral languages. The profiles 
of the participants in which group is described in detail below. 
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5.1 Participant profiles 


Five heritage speakers of Kukama, four males and one female, participated in 
this study. Their ages ranged from 24 to 36 (avg - 28), and they all attended 
FORMABIAP between 2012 and 2016.? They had two male instructors of Kukama, 
who are themselves community members and FORMABIAP alumni (see $3.2). 
During their training, they were also mentored by four Kukama specialists, two 
male and two female elder speakers, who worked in the project at different points 
in time. 

Data from anonymous questionnaires show that after finishing high school, 
they all wanted to become bilingual teachers, and four of the five participants 
indicated having the support from their communities and indigenous organiza- 
tion. As for their exposure to Kukama at an early age, four of the five participants 
indicated that their parents understand the language and that their grandparents 
would speak it, but only from time to time because they lack regular conversation 
partners. All the participants are aware of the level of endangerment of Kukama 
and seem committed to ongoing preservation efforts. They display very positive 
attitudes towards their Kukama identity and their heritage language; however, 
four of the five participants indicated they prefer not to speak Kukama outside 
their community contexts to avoid public shame. As for language ideologies re- 
garding language variation, all the participants acknowledge geographic and gen- 
erational differences; however, four of the five participants indicated they aspire 
to speak like the elders because they speak the true Kukama. 

Regarding their knowledge of Kukama at the time they enrolled in 
FORMABIAP, all of the participants say they knew common words and expres- 
sions. For words, the examples provided in the questionnaire are ipira ‘fish’, 
yawara ‘dog’ atawari ‘chicken’, arara ‘macaw’, uni ‘water’, irara ‘canoe’, ‘ya- 
pukita ‘paddle’, etc. For expressions, they listed: era na kuema/karuka ‘good 
morning/afternoon, tsaniuri ‘Come on in’, makatipa na utsu "Where are you go- 
ing’, ta tseta eyu ‘I want to eat’, ta kurata kaitsuma ‘I drink yucca bear’. Even 
though they knew some words and expressions, all of them said they could not 
understand and engage with fluent speakers of Kukama. In the self-assessment 
of their proficiency, all declared having made significant progress in learning the 
language. On a 5-point scale, they gave themselves an average score of 4.2 for 
reading and writing, and 3.2 for speaking and listening. 

Given the lack of baselines and benchmarks to assess proficiency in Kukama, 
a fluent, elder speaker with 20 years of experience as the community linguist, 


>The participants attended a propaedeutic in 2011, before starting their teaching training, but 
Kukama was not included in this preparatory phase. 
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and who was an instructor of the Kukama language in the FORMABIAP project, 
assessed the speech samples of all the participants. She listened to each story 
and grouped the participants into three categories: A: está aprendiendo 'he/she is 
learning’, B: habla, pero tiene que aprender y practicar más ‘he/she speaks, but 
needs to learn and practice more', C: ya habla, pero necesita corregir algunas 
palabritas ‘he/she speaks already, but needs to fix some little expressions’. We 
interpret these categories as A being towards the lower end of the proficiency 
continuum, and C towards the higher end of the continuum. According to this 
specialist, the participant kuk-1 should be in category A, KUK-2 and KUK-3 in 
category B, and KUK-4 and KUK-5 in category C. The profiles of the Kukama par- 
ticipants is summarized in Table 2. 


Table 2: Kukama participants 


Participant Gender Age Category 
KUK-1 M 36 A 
KUK-2 M 28 B 
KUK-3 F 24 B 
KUK-4 M 27 C 
M 25 C 


KUK-5 


5.2 Oral comprehension 


The data to assess oral comprehension comes from the activities with the video 
as explained in 84.1. All the participants completed the word recognition task 
with extreme ease. Remarkably, four of the five participants listed only those 
items that they clearly knew; only one participant listed a couple of nonwords, 
which were excluded from the counting. The vast majority of the items registered 
were content words, including nouns (e.g. marawi ‘hand fan’, miriti palm tree’), 
verbs (e.g. imaki ‘select’, kauki ‘wait’ ), and adverbs (e.g. ikun “today”, ikumenan 
‘soon’); only one participant listed also a few function words, such as pronouns 
and demonstratives (ex. ay ‘he/she’, ajan ‘this’). We included both of them in our 
calculations. 

The second task consisted of identifying phrases and sentences. All the partici- 
pants were able to recognize and isolate a variety of syntactic structures. Within 
the PHRASES category we report only those that were listed on their own, not 
as part of another larger syntactic constituent (i.e. NP objects within a clause 
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were not counted as phrases). This category comprises noun phrases (ex. ini 
puwa 'our hand), verb phrases (ex. uchima tsa 'extract the leaf") and nominal- 
ized constructions (ex. kuarachi tatatan 'something that has dried with sunlight"). 
Interestingly, no one listed postpositional phrases on their own. In the CLAUSES 
category, we included simple clauses (ex. ikun kuashi ini yauki marawi 'today 
we will make a hand fan’), complex constructions (ex. awanu tseta purepeta ajan 
‘people want to buy this’, ini yaukiai imaki ipukun ‘we make it by selecting the 
long ones’). The results are provided in Figure 2. Note that only one participant, 
KUK-1, listed more phrases (n = 9) than clauses (n = 5). All the other participants 
registered more complete clauses than phrases, which may point towards more 
advanced comprehension skills. However, there are not significant differences 
among the participants in the overall comprehension of phrases and clauses. In 
sum, the data suggests that all the participants have achieved strong comprehen- 
sion skills. 


words Mphrases W clauses 


Lu Lal 


KUK-1 KUK-2 KUK-3 KUK-4 KUK-5 
Kukama participants 


Figure 2: Kukamas' oral comprehension 


5.3 Oral production 


As with the comprehension tasks, we let the benchmarks for Kukama oral pro- 
ficiency emerge from the data itself. The literature on heritage language teach- 
ing and learning suggests that heritage learners follow unique trajectories and 


4 3: 6.549, p: 0.161727. The result for phrases and clauses is not significant at p < 0.05. It becomes 
significant if we include words. 
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should not be compared against traditional speakers (see, for instance, Valdés 
2005). Following this view, the benchmark to measure oral proficiency in this 
study is not the speech of the elders. In collaboration with speakers of the lan- 
guage, we transcribed the recordings of the stories produced by the participants 
to quantify several parameters. First, because each participant was invited to 
speak for as long as he/she wanted, we recorded the length of each story. Second, 
we quantified the total number of words used. Third, we calculated the number 
of word types (including both function words and content words) to get a sense 
of vocabulary knowledge and the amount of repetition of words. Finally, we cal- 
culated speaker rates as word-per-minute output by dividing the total number of 
words by the length of the stories. The idea being that lower proficiency speakers 
have more difficulty in accessing lexical items, which slows down their speech. 
The results for both stories are provided in Figure 3. 

The results for oral production suggest that participant KUK-1 is at a lower 
level in the proficiency continuum compared to the other participants, particu- 
larly with respect to the length of the stories and the overall number of words 
produced. Kuk-1's score for word types (n = 55) is also lower than the average 
for all the participants (avg = 94). However, a chi-square test comparing word 
types and speech rate reveals that there is not a significant difference among the 
participants.? 


Bllength seconds ` Dwords total word types  WMispeech rate 


a bla. 


KUK-1 KUK-2 KUK-3 KUK-4 KUK-5 
Kukama participants 


Figure 3: Kukamas’ word tokens and types in oral production 


An interesting finding is that the assessment provided by the Kukama special- 
ist does not align well with some scores in Figure 3. While her observations re- 


5 Y: 4.4693, p: 0.346208. The result for word types and speech rate is not significant at p < 0.05. 
It becomes significant if we add number of words. 
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garding KUK-1 seem to hold, according to this specialist, participant KUK-3 should 
be a little behind participants KUK-4 and kuk-5. Nevertheless, as shown in Fig- 
ure 3, KUK-3 has the highest scores for total number of words produced and word 
types employed. Thus, these scores offer only a glimpse into the story of this re- 
learning process. In order to have a fuller picture, and guided by the specialist's 
observations, we look into specific linguistic features produced by the partici- 
pants. 


5.4 Qualitative analysis 


Our results suggest that knowledge of lexical items and speech rate might not be 
correlated with grammatical knowledge and pragmatic competence. This seems 
surprising given that lexical access tends to also be accompanied by difficulty 
constructing phrases and clauses. Thus, some discussion of the results on specific 
subcomponents of the grammar are in order. 


5.4.1 Phonetics and phonology 


A recurrent observation about heritage speakers is that even the novice sound 
native-like, which contrasts with what we see in conventional second languages 
(Polinsky & Kagan 2007). This holds true for the Kukamas as well. For instance, 
impressionistically, their intonation patterns sound comparable to fluent speak- 
ers. Stress assignment is always on target; it is realized in the penultimate syllable 
except in words that end in a consonant (ex. éyu ‘eat’, eyún ‘food’). Phonologi- 
cal processes are consistently implemented (ex. sonorization of voiceless stops 
following nasals, as in temente [temende] ‘there is not’, ajanka [ajanga] ‘here’). 
Optional phonological processes are implemented randomly (palatalization of af- 
fricate tsitsa [chitsa] ‘face’). All participants tend to produce the central vowel 
/i/, as /i/. Arguably, they have not added yet this vowel to their vowel inventory. 


5.4.2 Morphosyntax 


In Kukama, grammatical categories such as person, number, tense, and modal- 
ity are conveyed by positionally fixed clitics. All the participants make use of a 
subset of these forms. Importantly, given that no suffix or clitic is obligatory in 
Kukama, the lack of bound morphology do not render structures ungrammati- 
cal. The most frequently used postpositions are -ka ‘locative’, -pu ‘instrument’, 
-muki ‘comitative’, and -kuara ‘inesive’. Documented verbal morphology include 
-ka ‘iterative’, -ta ‘causative’, -ari ‘progressive’. The completive -pa was not doc- 
umented, and the use of past tense markers is also limited. All the participants 
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also used plural markers and nominalized forms and their underived counter- 
parts. Some examples are eyu ‘eat’, eyun ‘food’ ipurkari ‘hunt’, ipurkarin ‘hunter’. 
The focus clitic =pura was used by two participants, and generally with the same 
host which suggests they learned it is a chunk, as shown in (1). 


(1) rian-puraikian  awa-kana umira yawara 
then=FOC DEM.MS person-PL.MS see 3sG.Ms dog 
‘at that moment these people see his dog’ 


One of the most salient typological features of Kukama is the presence of gram- 
maticalized gender indexicals (for details, see Vallejos 2015). Kukama does not 
have grammatical gender; that is, it does not encode the gender of a referent. Ku- 
kama’s gender indexicality is a categorical distinction that encodes the gender 
of the speaker. Male and female speech is expressed in several categories, includ- 
ing personal pronouns, indefinite pronouns, demonstratives, number marking, 
and connectors. Heritage speakers use plural markers, as =kana in (1), and the 
first-person pronouns (ta vs. tsa/etse) quite accurately. The second-person pro- 
noun, na, does not vary from women and men. However, some of the partici- 
pants tend to have difficulties with third-person pronouns (uri/ra vs. ya/ai) and, 
the first-person exclusive pronouns (tana vs. penu) did not show up in the sto- 
ries. Although one male participant used a few female forms (yamua instead of 
ramua ‘other’, yaepetsui instead of raepetsui ‘then’), male speakers consistently 
used male pronouns, as ra in (1). The female speaker had more difficulties with 
gender indexicals, as discussed further, below. 

Kukama has several strategies to combine clauses into more complex sen- 
tences. Clause nominalization is a central subordination strategy, particularly for 
relativization functions. The language has a set of subordinators to express sev- 
eral logical relations, such as cause, condition, and temporal simultaneity (Valle- 
jos 2016a). The participants made very limited use of clause combining strate- 
gies P To link simple clauses, they use prosody; clauses are produced within a 
single intonation contour and the semantic relationship between clauses are left 
to be inferred from context, as shown in (3). This is an area that needs attention. 

An area that seems to represent a challenge is information questions. Kukama 
has the interrogative marker -tipa that is attached to an interrogative pronoun, 
or the piece of information under interrogation. Only two participants attempted 
to make questions with this morpheme, the others used only rising intonation. 


*Two of the five participants used two purpose subordinators at once, but with the same verb 
(eyu-mira-tsen eat-PUR2-PUR3). This sequence may have been learned as a single chunk. 
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However, the syntactic structure of the attempted questions tends to be prob- 
lematic, as shown in example (2a), produced by kuk-5. In (2a), the sentence has 
an interrogative pronoun, but the interrogative marker is in the verb. Also, the 
subject of the clause is missing. The Kukama specialist provided two potential 
target constructions according to the context of the story, which are given in 
(2b). In the first, the identity of the object is being interrogated. In the second, 
the predicate is being interrogated, but in this case the object argument needs to 
be realized. 


(2 a. mari tseta-tipa eyu 
What want-INT eat 
"What want eat (Lit.) 
b. mari-tipa na tseta eyu / Tseta-tipa eyu-n 
What=INT 2sG want eat want=INT eat-NZR 
"What do you want to eat?’ ‘Do you want food?’ 


It should be highlighted that some types of complex predicate constructions - 
i.e., clause constructions with more than one predicate — are employed by all of 
them. Some examples are provided in (3c) and (3e), below. 


5.4.3 Discourse pragmatics 


Recall that according to the scores in Figure 2, the participants could be located 
at relatively similar points in the proficiency scale, except KUK-1. However, the 
Kukama expert put them in three groups. KUK-2 and KUK-3 were categorized 
in group B (“he/she speaks but needs to learn more and practice more"), while 
and KUK-4 and KUK-5 in group C (“he/she speaks already, but needs to fix some 
expressions") by the Kukama expert. The explanation seems to lie in the fact that 
their speech differs in terms of discourse organization. 

Story telling is an important cultural practice among Amazonian peoples. 
Kukama elders are generally exceptional storytellers, and most traditional sto- 
ries have a message regarding social norms and expectations in the community. 
These stories are told for the most part in the third person, and most of them con- 
cern animals interacting with each other and their surroundings (see an example 
in Vallejos 2018). Their stories are full of dialogue and direct quotations. To incor- 
porate direct speech from participants assigned to different sex categories, they 
re-center the referents of the gender indexicals for each speech event. The stories 
collected with the picture cards lack these features, which is perhaps explained 
by the artificiality of the stimuli. 
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Consider (3), an extract from one of the stories produced by participant KUK-4. 
This story flows well. There is almost null use of bound morphology, but this 
speaker employs complex predicate constructions, as in (3a), (3c), and (3e), as 
well as reduplication of verbal roots, as in (3e), to express aspectual subtleties. 


(3) a. ra utsu umi wepe, wepe uka animaru 
3sG.MS go see one one house animal 


b. ra chiwiki 
3sc.Ms dig 
c. ra utsu tsetuni, 


3sG.MS go smell 


d. tsetuni ria animaru, hm 
smell too animal hm 


e. ra yupuni kari-kari 
3sG.Ms start scrape-scrape 
'(a) It [hunting dog] goes to see one, a house of an animal, (b) he digs, 
(c) he goes to smell it, (d) to smell this animal's (house), (e) he starts 
to scrape and scrape’ (KUK-4) 


An interesting point that emerged in the speech of participants KUK-2 and 
KUK-3 is the overuse of the second person singular pronoun na for impersonal 
functions. Elder, traditional speakers of Kukama do not use na for generic, imper- 
sonal reference. In the excerpt in (4), the speaker KUK-2 seems to be describing 
the activity of hunting, not creating a story about the dog. If we substitute the 
pronoun na ‘you’ for ra ‘he/she’, we would have a third person story, similar to 
what we see in (3). In the extract in (5), the participant KUK-3 uses of na in sim- 
ilar ways, although in some cases, the resulting constructions are problematic 
and difficult to understand, as in (5d). 


(4 a. na papa, na 
2sc father 25G 


b. na erutsu yawara-muki 
2sc bring dog=com 


c. na chikari wepe animaru 
2sc look.for one animal 


d. ikian,na papa, na 
this 2sc father 2sG 
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e. na utsu taira-kana 
2sG go daughter-PL.Ms 
‘(a) Your father, (b) brings you with the dog, (c) you look for an 
animal, (d) this one, your father, (e) you go with the daughters' 


(5) a. ajan wepe yawara ipurkari-n umi-ura 
this.rs one dog — hunt-NZR see=3SG.MS 


b. umi-ura na tseta upi=nan [...] 
see-3sc.Ms 2sc want all-roc 
c. tima na, na yumieyu-n TL 
NEG 2sG 2sG give eat-NZR 
d. upi-nantua-n-kana  titicka na eyu-mira 
all=roc big-NZR=PL.MS alone-REI 2sG eat-PUR 
e. timana yumi animaru ipurkari-n 
NEG 2sG give animal hunt-NZR 
‘(a) This hunting dog sees it [the food], (b) sees it (but) you want all, 
(c) you don't share the food, (d) all the adults are alone for you to eat, 
(e) you don't give to the hunting dog’ 


But why would these two participants use na instead of ra in story telling? 
One hypothesis is because the second person pronoun does not vary depending 
on the speaker's gender, as does the third person (ra vs. ya). A second hypothesis 
is Spanish influence. This impersonal use of na resembles the use of Spanish tu 
for similar discourse functions in Amazonian Spanish (Vallejos et al. 2020), as 
well as in English as evidenced in the translations. 

The fragment in (5) is also interesting for other reasons. Speaker KUK-3 uses 
more bound morphology than other participants (Oe, the plural marker, clitic 
pronouns, nominalizer, focus, the subordinator of purpose), but recall that this 
speech was nonetheless rated lower than of KUK-4 and kuk-5. In addition to 
the overuse of na, this speaker mixes gender indexicals. For instance, in (5a), 
KUK-3 uses ajan, the demonstrative of female speech, but in the same line she 
uses =ura, the clitic pronoun for male speech (instead of =ay), and in (5d) the 
plural marker for male speech =kana (instead of =minu). Traditional speakers 
tend to be sensitive to the use of gender indexicals. But mastering this feature 
is difficult, and more so if there is not enough input of both types of speech and 
opportunity for practice. Note that the instructors of Kukama are males. Hiring 
female instructors should be considered in instructional planning in the future. 
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An additional point to note regarding the speech of heritage speakers is the 
innovative uses of wepe ‘one’. This cardinal number is used as indefinite deter- 
miner, as seen in (3a), (4c), and (5a), probably because of Spanish influence. For 
example, everyone said wepe kuashi ‘one day’, which would work well if we were 
counting days, but not to make reference to a point in time in the past. For these 
function, traditional speakers would use expressions such iminua ‘long time ago’, 
yamua/ramua kuashi ‘another day’, ikun kuashi ‘today’, etc. 

A final point regarding discourse is the very limited use of code switching by 
these participants. They all inserted very few loanwords, but nothing that would 
be considered switches to Spanish. This is surprising since in a previous study, 
with a different speaker sample (Vallejos 2016b), switching was extensively used 
by heritage speakers. A possible explanation is that the participants in this study 
have studied under different instructors. 


6 Results: Kichwa 


6.1 Participant profiles 


Three heritage learners of Kichwa participated in this study: two women and one 
man. KICH-1 and KICH-2 are women, and their ages are 30 and 35, respectively. 
They attended FORMABIAP between 2015 and 2019 to get training as teachers 
of preschool education (Educación Inicial Intercultural Bilingiie) during the sum- 
mer periods. It needs to be highlighted that the training of preschool teachers is 
different from the training of elementary school teachers. The former are teach- 
ers that must have a teaching position in a preschool to attend formal training 
in FORMABIAP; the latter do not hold a teaching position prior to graduation. 
As a result, participants KICH-1 and KICH-2 have had limited access to structured 
classes of Kichwa during their time at FORMABIAP; that is, they are mostly learn- 
ing the language in their villages while working with kindergarteners. The third 
participant is a 22-year-old man; he attended FORMABIAP from 2012 to 2017 to 
become an elementary school teacher. As such, he has taken classes of Kichwa 
during his five years at FORMABIAP. 

In the anonymous survey applied, two participants said they entered 
FORMABIAP because of the scholarship offered to carry out their studies, and 
because of the support of their communities and families. However, the three of 
them indicated that their motivation to learn Kichwa emerged in the framework 
of their professional training in FORMABIAP. xicu-3 self-reported that, in ad- 
dition to the classes at FORMABIAP, he systematically immersed himself with 
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fluent speakers in the villages where Kichwa is the dominant language to gain 
proficiency. 

Regarding prior knowledge of Kichwa before entering FORMABIAP, they 
stated that they knew common words like challwa ‘fish’, wallpa ‘hen’, 
yachachikama ‘teacher’ and phrases like allipuncha ‘good morning’, shamuy 
‘come’, kuyntaway ‘tell me’. However, they may have comprehended more words 
and phrases because two of them said they listened to their grandparents speak 
Kichwa during their childhood. All three said that in their community there were 
older adults who spoke Kichwa fluently. That is, the three participants of this 
study were exposed to Kichwa during their childhood by their grandparents and 
other elders; however, they did not foster the use of the language because the 
social conditions did not exist. 

In the same survey, the three participants indicated they are proud of the 
Kichwa language and think that the elders speak the true Kichwa and that the 
young people should learn from them. In summary, the three participants have 
a strong appreciation of Kichwa, which is a good motivation to continue to learn 
this language. 

A Kichwa specialist assessed all the speech samples to provide some input re- 
garding the overall proficiency of the participants. According to this specialist, 
KICH-1 and KICH-2 should be assigned to category B (habla, pero tiene que apren- 
der y practicar mas ‘he/she speaks, but needs to learn and practice more’), while 
KICH-3 is in category C (ya habla, pero necesita corregir algunas palabritas para 
hablar fluido ‘he/she speaks already, but needs to fix some little expressions to 
speak fluently’). That is, KICH-3 is the most advanced of the three in terms of 
proficiency. A summary of the profiles of the Kichwa participants is given in 
Table 3. 


Table 3: Kichwa participants 


Participant Gender Age Category 
KICH-1 F 30 B 
KICH-2 F 35 B 
KICH-3 M 22 C 


6.2 Oral comprehension 


Given some technical difficulties, we could not collect oral comprehension data 
similar to the Kukamas. However, two Kichwa instructors who taught the three 
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participants indicate that all of them display advanced oral comprehension to 
fully understand narratives and descriptions. For example, in FORMABIAP there 
are certain sessions conducted entirely in the Kichwa language. Those sessions 
are dedicated to teach both the language itself, as well as socio-cultural studies. 
According to the instructors, the three Kichwa participants successfully partici- 
pated in those sessions, working in close collaboration with other fluent Kichwa 
speakers. The second and third authors have worked with these participants, and 
believe the three of them have achieved advanced oral comprehension skills be- 
cause they are originally from the Mid Napo River. As indicated in $2.2, in those 
villages, the generations of parents and grandparents still speak the language on 
a daily basis; thus, the conditions to relearn Kichwa are relatively favorable. 


6.3 Oral production 


To collect oral production data, we employed a similar strategy to the one used 
with the Kukamas. The participants organized the sets of cards and briefly de- 
scribed them creating a story. 

The results for the oral production task are given in Figure 4. They show that 
participant KICH-3 is at a more advanced level in the proficiency continuum com- 
pared to the other two participants, particularly with respect to the length of the 
stories and the overall number of words produced. KIcH-3’s score for word types 
(n = 144) is above the average for the three participants (avg = 92). The only 
score in in which KICH-1 and KicH-2 are above KICH-3 is speech rate. However, a 
chi-square test comparing word types and speech rate reveals that there is not a 
significant difference among the participants.’ The assessment provided by the 
Kichwa specialist aligns well with most of the scores in Figure 4. An analysis of 
specific linguistic features produced by the participants is found in Figure 4. 


6.4 Qualitative analysis 
6.4.1 Phonetics and phonology 


The participants KICH-1, KICH-2 and KicH-3 do not differ much from fluent 
Kichwa speakers with respect to the production of different sounds, intonation 
and even accent patterns. One of the phonetic characteristics of Kichwa is the 
sonorization of the voiceless stops /p, t, k/ which become [b, d, g], respectively, 
after a nasal consonant. For example, /fiampi/ ‘path’ is realized as [ñambi], /in- 
DI ‘sun’ is produced as [indi]; /chunka/ ‘ten’ is produced as [chunga]. All the 


7y?: 4.4693, p: 0.346208. The result for word types and speech rate is not significant at p < 0.05. 
It becomes significant if we add number of words. 
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Dlength seconds Mwords total word types  Mispeech rate 


KICH-1 KICH-2 KICH-3 
Kichwa participants 


Figure 4: Kichwas' oral production 


participants apply this voicing process. The stress pattern in Kichwa falls on the 
penultimate syllable, but in the spontaneous speech of fluent speakers, a word 
can undergo reduction ofthe stressed vowel, in which case the accent falls on the 
last syllable. For example, /manáchu/ ‘is not true’ becomes [manchú]. This vowel 
reduction phenomenon is documented in the speech of these heritage speakers 
as well. A related phenomenon is the fact participant kich-3 stresses the last syl- 
lable of some words like [tupán] that are generally produced as /túpan/ ‘to meet 
someone’, although this issue seems marginal. 


6.4.2 Morphosyntax 


Kichwa is an agglutinating, suffixal language; nominal and verbal words are con- 
stituted of a verbal and nominal root and their respective suffixes. Grammatical 
relations are expressed via case marking including the accusative -ta, and the in- 
direct object -ta or -ma. Non-core arguments are marked by a set of postpositions, 
the most frequent being the locative -pi, the allative -ma (when the noun is non- 
human), the allative -pam (when the noun is human), the ablative -manta, and the 
comitative/instrumental -wa. The main predicate of the clause is marked mainly 
with person indexes including: -sha “1sG.ruT”, -nki‘2sc’, -nka '3sc.ruT'. The main 
verb can also take the tense marker -rka past, aspectual markers such as -ra/-hu 
‘durative’, -shka/-ska ‘perfective’, and the causative marker cht All these mor- 
phemes are basic and frequent in everyday conversation. The preferred order of 
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constituents in the clause is SOV, but this pattern is flexible because the core 
and non-core arguments are morphologically marked, with the exception of the 
subject argument. Thus, moving arguments around the clause does not alter the 
propositional meaning of the utterance, although it may change its pragmatics 
(Papa Coquinche & Rosales Alvarado 2015). 

The three Kichwa participants seem to know most of the morphemes listed 
above. Participants KICH-1 and KICH-2, however, are in the process of strength- 
ening the proper use of these suffixes. Note that the presence or absence of these 
morphemes can change the meaning of an expression in substantial ways. The 
example in (6a) was extracted from the story produced by Kicn-1. It shows that 
this participant is learning to use the accusative -ta, the causative cht and the 
locative -pi. In the context of the story, (6a) is trying to make reference to the 
fact that the owner of the dog makes his pet happy. This is also inferred from the 
transitivizer -ya in the verb. But this example lacks the accusative marker -ta in 
dog, and the causative -chi in the verb. The target construction provided by the 
Kichwa specialist is given in (6b): 


(6) a. Pay-pa allku sumak-ta kushi-ya-shka 
3SG.PRE-GEN dog beautiful-Apvzn be.happy-TRS-PFV 


‘His dog got happy beautifully’ (Lit) 


b. Pay-pa allku-ta sumak-ta kushi-ya-chi-shka 
3SG.PRE-GEN dog-Acc beautiful-ADVzR be.happy-TRS-CAU-PFV 


‘He made his dog very happy’ 


The following example was also produced by kicH-1. It shows that the verb 
has the necessary morphology of a finite verb. However, this participant used 
the instrumental marker -wa instead of the locative marker -pi to indicate that 
the bench is where the sitting takes place. The target construction is given in 


(7b). 


(7 a. Chaymanda chay runa shuk banka-wa tiya-ri-rka 
then DEM person one bench-INS sit-INC-PAS 


"Then that person sat with a bench’ 


b. Chaymanda chay runa  shukbanka-pi tiya-ri-rka 
then DEM person one bench-LOC sit-INC-PAS 


"Then that person sat on a bench' 


Participants KICH-1 and KICH-2 also show some inconsistencies with respect to 
preferred order of constituents. The speech sample of K1cH-3 also shows some of 
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the same inconsistencies described above, but these are less frequent and mostly 
in the context of complex sentences. 

One of the most salient morphological features of this language is the use of 
personal pronouns with the genitive marker -pa to express possession within the 
noun phrase. For example, in [fiuka-pa yaya] ‘my dad’, the first-person pronoun 
fiuka is marked by the genitive marker -pa. In spontaneous speech, however, flu- 
ent speakers tend to drop the genitive marker, and possession is expressed by 
word order alone. As a result, fluent speakers have two variant constructions for 
adnominal possession: [PRO-pa N] and [PRO N]. Participants kICH-1 and KICH-2 
are able to use the first variant, with the genitive marker. However, KICH-3 al- 
ready uses both variants, as shown in (8) and (9). Note that, in (8), the suffix -pa is 
missing in [pay wasima] ‘at his house’. Thus, KIcH-3 seems not only aware of the 
morphosyntactic variants but uses both of them effectively, which contributes to 
propel him towards the more advanced end of the proficiency continuum. 


(8) allku pay-pa amu-ta  riku-sa pay-pa chupa-ta kuyu-ri-rka 
Dog 3sG-GEN owner-Acc see-MOD 3SG-GEN tail-ACC move-INC-PAS 


‘Looking at his owner, the dog moved his tail’ 


(9) wayu-kuna-ta apa-sa rin pay wasi-ma 
fruit-PL-ACC  carry-MOD go-3sG 3sG house-ALL 


‘He goes to his house carrying fruits’ 


To form complex sentences, Kichwa employs subordinator suffixes, such as -pi 
to express ‘temporal overlap’, -sha/-sa to express ‘manner’, and -nkapa to express 
the purpose of the action conveyed in the main clause. KICH-3 uses all these com- 
plex structures, as shown in the following extract from a story produced by this 
participant. Subordinators are employed in (10b), (10c), and (10d). Participants 
KICH-1 and KICH-2 use mostly sequences of simple clauses, although they tend to 
join them using discourse connectors, as shown in (11), below. 


(10) a. Mama rima-n pay-pa wawa-kuna-ta: 

mother speak-3sG 3sG-GEN son-PL-ACC 

b. “maska-kri-sha wayu-kuna-ta kan-kuna-ta kara-nkapa” 
look.for-go-1SG.FUT fruit-PL-ACC 2SG-PL-BEN give-PUR 

c. chasna rima-pi pay-pa mama puri-sa sacha-man 
like.this speak-TEMP 3sc-GEN mother go.around-MAN jungle-ALL 
ri-n, 
go-3sG 
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d. sacha-pi  puri-pi tupa-n mishki muyu-kuna-ta 
jungle-Loc go.around-TEMP find-3sG sweet seed-PL-ACC 
‘(a) Mother speaks to her sons. (b) “Tl go look for fruits in order to 
give you (to feed you)". (c) Speaking like this, mother goes walking 
around towards the jungle. (d) When she was walking around in the 
jungle, she found sweet seeds' 


6.4.3 Discourse pragmatics 


At the discourse level, there is a tendency to use connectors to link ideas con- 
veyed in simple structures. This is particularly evident in the speech of KICH-1 
and KICH 2. The extract below from a story by kicH-1 shows this. The frequent 
use of chaymanda ‘then’ and adverbs of time such as washa ‘then, later’ is no- 
ticeable, as in (11a) and (11d). This speaker seems to be using connectors instead 
of subordinators to link clauses. 


(11) a. Pay-pa amu wawa hampi-naya-shka 
3SG-GEN owner kid cure-DES-PFV 


b. chay allku mana muna-rka 
DEM dog NEG want-PAS 


c. chaymanda chay runa  wan-chi-shka chay lumucha-ta 
then DEM person die-CAU-PFV DEM agouti-ACC 


d. wan-chi-shka washa pay-pa wasi-ma  ri-rka 
die-CAU-PFV after 3sG-GEN house-ALL go-PAS 
'(a) His owner, the kid, wanted to cure him [the dog]. (b) that dog 
didn't want to. (c) then that person killed the agouti. (d)After killing, 
he went to his house. 


An important feature of Kichwa is the focalizer -ka. This marker operates at 
the level of discourse to explicitly highlight a piece of information about which 
one wants to draw attention. Focalization strategies are an interesting aspect in 
the learning process of heritage speakers. The only participant that makes use 
of this suffix is KICH-3; however, he makes an excessive use of the focalizer, as 
evidenced in (12) and (13). In sentence (12), three elements are focalized, in (13) 
four elements. Fluid, native speakers focus only one element per sentence. 
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(12) Sacha-pi  puri-pi-ka allku-ka fia mushti-sa-ka 
jungle-Loc go.around-LOC-FOC dog-roc already smell-MAN-FOC 
kati-n shuk sacha wiwa-ta. 
follow-3sG one monte animal-Acc 
"When a dog goes around in the jungle, he chases a wild animal by 
smelling’ 


(13)  wan-chi-ska washa-ka, fia all-kuna-ka karachupa wawa-kuna-ta-ka 
die-CAU-PFV after-roc already dog-PL-FOC armadillo breed-PL-ACC-FOC 
wan-chi-pi-ka sakinaku-n 
die-CAU-TEMP-FOC leave-3sG 
‘After killing the armadillo's babies, the dogs leave them dead’ 


Participants KICH-1 and KIcH-2 do not employ the focalizer marker. In sum, 
some areas of pragmatics pose significant challenges for heritage learners of both 
Kichwa and Kukama. 


7 Implications for instruction of heritage languages in 
Amazonia 


The aim of this study was to explore how much heritage speakers can achieved 
in the process of relearning their ancestral languages in higher education pro- 
grams. An examination of the use of Kukama and Kichwa as a response to au- 
diovisual stimuli by eight FORMABIAP alumni reveals that heritage languages 
can be relearned in the context of formal education, as long as other forces and 
context dynamics are present as well. Overall, all the Kukama and Kichwa her- 
itage speakers in this study demonstrated strong comprehension skills and have 
also achieved varying degrees of production skills. Speakers show some patterns 
from beginners, to intermediate levels, to quite advanced proficiency. 

In addition, this study found that some features found in the speech of heritage 
speakers are similar to those found in the speech of elder speakers, but there are 
also some distinctive emerging patterns. Some of them are listed in Table 4. 

The findings in Table 4 are hardly surprising, as accelerated language change 
is expected in contexts of language endangerment and language revitalization 
(Hinton 2001, Vallejos 2016b). For example, speakers of Navajo (Athabaskan), 
recognize themselves as either traditionalists and non-traditionalists. The use 
of Navajo specialized vocabulary, as well as some structural features such as 
the hierarchy of classification of nouns (Hale 1973), is very rare among non- 
traditional speakers (Wayne et al. 2003). Another example comes from Blackfoot 
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Table 4: Some patterns identified in the speech of heritage speakers 


Kukama 


Phonetics and phonology 


Participants master most sounds, 
stress and intonation patterns 


Participants tend to produce the 
central vowel /i/ as [i] 


Morphology 


Kichwa 


Participants master most sounds, 
stress and intonation patterns 


Participants apply some general 
phonological rules 


Participants know a subset of 
postpositions and clitics 


Participants use few pronominal 
gender indexicals 


Syntax 


Participants know most case and 
tense suffixes 


Participants are strengthening the 
use and combination of suffixes 


Participants know basic declarative 
clauses and attempt interrogative 
constructions 


Participants employ prosody to link 
simple clauses instead of clause 
subordinators 


Discourse pragmatics 


Participants know basic declarative 
clauses and attempt different word 
order possibilities 


Some participants use clause 
subordinators, others use sequences 
of simple clauses 


Participants use personal pronouns 
for impersonal functions in 
narratives 


Participants employ reported speech 
instead of direct speech 


Participants use focalizing strategies 
in narratives 


Participants focalize multiple pieces 
of information per clause instead of 
selecting only one 
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(Algonquian). There are two varieties referred to as Old or High Blackfoot, spo- 
ken by elders, and New or Modern Blackfoot, spoken by the new generations. 
Among the features found in High Blackfoot is the extensive use of incorpora- 
tion; however, this pattern is no longer used by the Modern Blackfoot speakers 
(Miyashita & Shoe 2009). In the Amazon, Danielsen & Terhart (submitted) re- 
port several structural innovations among latent-speakers of Baure (Arawakan). 
Thus, it is important to document the progress made by these learners, as well 
as the innovations that might be emerging in their speech. 

Given that languages are surrounded by variation and diversity, we do not be- 
lieve language instruction should be restricted to achieve an abstract ideal of stan- 
dard. Yet the findings of this study point to some areas that may need attention in 
terms of curricula development. Providing specific suggestions for heritage lan- 
guage instruction is beyond this paper, but the analysis provided here could be 
taken as a starting point for Kukama and Kichwa. For example, given the central 
role of orality in the life and social organization of the communities, facilitating 
greater exposure and practice of storytelling could help the progress of heritage 
learners. In addition, practical activities, such as the description of specific pro- 
cesses and concrete objects, activities with visual stimuli such as those used here, 
could help promote oral production and the expansion of vocabulary. The design 
of grammar instruction sessions aimed at overcoming difficulties with specific 
patterns, for example some of those listed in Table 4, seems desirable. Finally, the 
need to build a community of practice cannot be underestimated. Real interac- 
tion outside the classroom with those who speak the heritage languages is key 
to progress in the learning process. 

Another important finding of this study is the positive attitudes shown by all 
the participants towards their identity and their heritage languages. To relearn 
a heritage language, particularly one with limited communicative functionality 
and prestige, motivation and commitment seem crucial. In addition, document- 
ing progress is also important. Setting achievable goals, developing autonomy, 
and continuous self-assessment of learning are critical. 

The assessment of heritage language learners should go way beyond language 
skills and explicit grammatical knowledge. A holistic approach must include also 
pragmatic knowledge, including the control of socio-cultural language norms, as 
well as awareness of linguistic variation in their communities. As indicated above, 
language attitudes and ideologies surrounding these languages, as well as learn- 
ers' cultural connection with their ethnic group should be part of the picture as 
well. Finally, their political positioning with respect to their communities and in- 
digenous organizations is also essential, especially in the context of the Peruvian 
Amazon. 
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8 Closing remarks 


Language revitalization initiatives have been taking place in Latin American for 
some time now; however, the impact of such efforts in the creation of new speak- 
ers has not been documented thoroughly. There is a need to establish the baseline 
for each heritage language. This task requires detailed knowledge of each specific 
language, the sociocultural context, the demographic patterns of dialectal varia- 
tion, etc. For Amazonian languages, this information is generally not available 
or systematized, and would need to be collected prior to a serious assessment of 
specific revitalization initiatives. 

Given the degree of endangerment of the heritage languages involved, espe- 
cially for Kukama and for some Kichwa villages, a significant finding of this study 
is that endangered languages can be relearned in well-structured instructional 
settings. We demonstrate that the outcomes of the methodology implemented 
by FORMABIAP are both tangible and substantial. The results reported here can 
help advance the discussion about model design and strategies to work with her- 
itage languages within the classroom and beyond. One of the most important 
findings is the participants' commitment to their language, their community, and 
their indigenous organizations. They express a strong motivation to continue to 
learn their heritage language as they teach it to children. It should be clear by 
now that Kukama and Kichwa are not conventional second languages and should 
not be treated as such in higher education. What pedagogical challenges heritage 
learners of indigenous languages bring to the classroom is an important question, 
and we hope to have contributed to the start of this discussion with this study. 
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Abbreviations 

ACC accusative MAN manner 
ADVZR  adverbializer MS male speech 
CAU causative NZR  nominalizer 
COM comitative PAS past 

DEM demonstrative PFV perfective 
INC incoative PRE present 

INT interrogative PUR ` purpose 

FOC focus TEMP temporal overlap 
FUT future TRS  transitivizer 
LOC locative 
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This chapter discusses the case of multilingualism and context-based approaches 
to assessment as an eclectic approach that requires a robust knowledge and un- 
derstanding of the linguistic diversity of language learners. It also calls for a more 
inclusive approach in the design and implementation of assessment in higher ed- 
ucation. We also connect the findings from the contributions to this volume and 
their research to an ecological approach to assessment as it relates to linguistic 
sensitivity in multilingual contexts. The chapter ends by suggesting future direc- 
tions for research based on alternative assessment and connecting those to current 
issues in language learning and assessment. 


Assessment works when we learn to look at it as a 
process for improving the quality of our teaching. It 
works when we dialogue with colleagues, both within 
our discipline and across campus, and create new 
ideas to help students learn. Assessment works when 
we try something new and don't get disheartened 
when it doesn't work; instead, we reevaluate and try 
something else. Assessment works when something 
new proves effective and we gain information that 
moves our curriculum forward. Assessment can work 
if we quit making excuses as to why it's so difficult 
and messy and instead look to the information to 
reinforce what works and discard what doesn't. 
Assessment works when we embrace the challenge of 
always getting better 

Vickie Kelly (2017, Washburn University) 


Rosita L. Rivera & Eva Rodríguez-González. 2022. Pedagogical implications of assess- 
ment in multilingual contexts. In Eva Rodríguez-González & Rosita L. Rivera (eds.), 


formal environments, 193-205. Berlin: Language Science Press. 
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1 Linguistic sensitivity and pedagogical training in 
language assessment 


As researchers continue to develop multiple ways to document learning growth 
and development, the different needs for teacher training continue to grow. Lan- 
guage program coordinators designing curricula for language courses may face 
many challenges if they choose to focus primarily on proficiency skills and stan- 
dardized language testing. For instance, in classroom-based language scenarios, 
interpersonal and intercultural competence may be left behind or not prioritized 
in terms of learning outcomes and, as a result, the social aspect of language devel- 
opment might not be monitored or even paid that much attention for assessment 
purposes. In this regard, Malovrh & Menke (2021) state that both the limitation 
and the challenge “is not necessarily in identifying the problem, but in allocating 
institutional resources (both human and financial) to revising and designing cur- 
ricular sequences that systematically develop desired learning outcomes" (2021: 
500). In this regard, Phakiti & Isaacs (2021) highlight the importance of assess- 
ment literacy and make a call to the scholarly community to empower teachers 
"to deal and communicate with external mandates such as government or state 
agencies who often impose external assessments on students and educational 
systems. For teachers, understanding assessment quality is more important than 
ever" (2021: 19). The authors recommend excellent resources for teachers (2021: 
Appendix A) and call them to be critical consumers of learning materials and 
assessment instruments (Brown & Trace 2017), including through professional 
development activities (Harding & Kremmel 2017). 

The integration and emphasis on linguistically responsive instruction that is 
both inclusive and offers a variety of opportunities for activities and assessment 
tools should be explicit and prioritized in language learning contexts. However, 
as Huang & Laskowski (2014) point out for English second language teaching, 
translating such a view of language education into classroom practice requires 
the instructor to be linguistically sensitive to both the content and tasks that 
learners face during their own learning path. While studies exist to show how 
effective language instructors integrate language and content and prepare fu- 
ture language speakers for the job market, research attention is still emerging 
on how instructors are trained to be equipped with the needed knowledge and 
skills on assessment techniques. Thus, it is important to consider how instructor- 
training may benefit from integrating awareness of multilingual learners' reali- 
ties. The notion of an “ideal learner" or “test-taker” could be challenged through 
instructor-training that presents different ways of assessing language learning 
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to encourage collaboration and linguistic mediation among learners. When re- 
ferring to training where teachers also learn about language anxiety, the role of 
emotions in the language classroom, power dynamics, and agency in and outside 
of the classroom is key to assessment of languages. In this regard, the chapters 
by Thompson (2022 [this volume]) and Rodríguez-González et al. (2022 [this vol- 
ume]) in the present volume offer suggestions on the kind of activities and assess- 
ments that are sensitive to the multiple learner profiles within a given classroom 
setting. Thompson's IPAs and language portfolios are examples of multidimen- 
sion assessment tools that measure language performance and consider learner 
reflection as an ongoing process that documents language growth. Similary, the 
chapters by Rodríguez-González et al. (2022 [this volume]) and Dickinson & Mar- 
tinez (2022 [this volume]) in this volume identify a specific learner survey (Can- 
Do statements survey) that allows both the learner and instructor to monitor 
learner self-efficacy and language development. 

Because assessment is process-oriented, it has significant potential for explor- 
ing language and culture from an interdisciplinary and midway perspective. By 
including multiple modalities of assessment such as those done via self-assess- 
ment and questionnaires where learners and community members share percep- 
tions of their own language use, experience and learning such as the ones used in 
this volume by Silva in her article on Brazilian Heritage Portuguese and Vallejos 
et al. when assessing Kukama and Kichwa, we acknowledge challenges in learn- 
ing and embrace innovative instructional practices in response to cultural and 
linguistic diversity. Additionally, by involving peers and community members 
in assessment practices, we will be allowing spaces for creative interpretation 
that include individual and collective voices that engage with each other when 
monitoring language development and personal growth. Through critical, self- 
reflexive practices embedded in our research about language learning, teaching 
and assessment, we can work against racial, cultural, linguistic, and socioeco- 
nomic inequalities by creating humane classrooms and/or communities of prac- 
tice where learners and instructors learn together to use language and literacy 
in critical and empowering ways. 

When preparing and training future language instructors or accreditors that 
willbe in charge of documenting and monitoring language assessment, educators 
should serve as advocates and models of social justice and equity. Social justice- 
oriented instructors and trainers play a significant role in seeking alternative 
ways to address various forms of official knowledge with the learner populations 
they serve, especially forms of official knowledge that marginalize certain groups 
while privileging others. For instance, language assessments should be shaped 
according to multiple heritage language profiles and second language learners. 
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In this volume, Rodríguez-González et al. (2022 [this volume]) describes assess- 
ment tools and provides instructions for implementation in classroom settings 
for both heritage language speakers and second language learners. Additionally, 
the chapter by Hernández (2022 [this volume]) on pragmatic development offers 
suggestions for assessing pragmatic language growth in study abroad language 
settings. By means of reviewing the existing literature on the topic, Hernández 
carefully examines how pragmatic knowledge can be measured and included as 
another key area in language learning and curriculum design. Instructors should 
also envision classrooms as safe spaces for struggle and transformative action 
and social change. For instance, community-based language learning and study 
abroad experiences (see Hernández 2022 [this volume], Silva 2022 [this volume] 
and Dickinson & Martinez 2022 [this volume]) offer a plethora of opportunities 
for creative and reflective assessment practices that allow learners to shape their 
own transformations and interconnect themselves with others in a more natu- 
ralistic way than what a traditional classroom and curriculum might offer. 

In a 2005 position statement from the National Council of Teachers of English 
(NCTE 2005) entitled "Supporting Linguistically and Culturally Diverse Learn- 
ers in English Education”, the following beliefs and recommendations were sug- 
gested as a call for action. All of them may serve well as a point of reference 
for consideration for instructors, program coordinators and scholars working on 
alternative language assessments that are sensitive to the multiple realities of 
learners: (1) respect for all learners; (2) funds of knowledge; (3) inquiring into 
practice; (4) variety of educational experience; (5) modeling practice; (6) critical 
users of language; (7) crossing cultural boundaries; and (8) teaching as a political 
act. These recommendations from the NCTE 2005 report, although more aligned 
for teaching per se, have implications for language assessment. For example, in- 
stead of creating language activities and assessments where accuracy in sentence 
formation and vocabulary use may be biased towards a variety or dialect of the 
target language as determined by power and prestige, instructors acknowledge 
and give credit for different ways of addressing people, different culture-driven 
practices to denote proximity and kindness as a way to respect all learners and 
speakers. How do instructors and teacher educators successfully integrate the 
funds of knowledge learners bring into their pedagogic and assessment stance? 
Reflection journals and presentations of community-based projects such as the 
ones identified by Thompson in the present volume open a myriad of opportu- 
nities for intercultural competence regardless of whether the learner has shared 
that reflection on the target language or not. The learner becomes his/her own 
agent and funds of knowledge for assessment. The assessment piece in learner's 
reflections would not need to have a rubric or a scale of points for a grade, but 
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rather credit should be confirmed via a checklist of the items requested by the 
instructor to be included in the reflection (subjective scoring based on evidence 
provided in the reflection as checked by both learners and instructor). For in- 
stance, the Can-Do statements survey used by Rodríguez-González et al's and 
Dickinson & Martínez in this volume serves as an example of an assessment tool 
that uses reflection and is learner-driven. 

Educators may benefit from learning more about sociolinguistics both in 
teacher preparation programs and in ongoing professional development. Devel- 
oping this kind of knowledge may help to avoid language marginalization (Delpit 
& Kilgour Dowdy 2003). By training future instructors in alternative assessments, 
they will have a positive impact on the attitudes towards those assessment (vs. 
traditional ones) and their own attitudes and beliefs about the nature of language 
learning may organically evolve as well when applying multiple ways and tools 
of assessment (see Shahbari & Abu-Alhija 2018 for findings related to prospec- 
tive Mathematics teachers on alternative assessments). Examples of professional 
development related to alternative assessments could include but not limited to 
workshops on the inclusion of portfolios as "bodies of evidence" to document 
learner's individual paths and growth in multiple communities of practice that 
differ substantially from the traditional classroom (see Thompson 2022 [this vol- 
ume] for Portfolio recommendations and Green's (2014) PRICE principles for 
promoting effective classroom assessment- Planning, Reflection, Improvement, 
Cooperation, and Evidence). 


2 An ecological approach to assessment 


As we finished this volume, we were in the middle of a pandemic that challenged 
language instruction and assessment in all contexts. Language practitioners are 
now faced with new approaches to dealing with a crisis. The pandemic is one 
example that challenged everyone, but there are also multiple contexts dealing 
with other issues such as natural disasters. Learners and educators may not have 
access to the same sources, which creates a disparity between formal and in- 
formal assessment (Malovrh & Menke 2021). These disparities are largely due 
to factors ranging from design of formal and informal assessment to measuring 
proficiency. Yet, learners' futures depend on the design and implementation of 
these instruments. Ortega (2017) and Mazak & Carroll (2016) make a case for chal- 
lenging the ontological view of monolingual ideologies in language research and 
practice. New lines of inquiry are also undertaking an ecological orientation in 
language learning and assessment in SLA (Larsen-Freeman 2017). This epistemo- 
logical view of a dynamic and contextual approach to assessment could also be 
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applied to foreign language instruction in multilingual contexts. This perspec- 
tive acknowledges that language learning and assessment do not take place in 
isolation from the temporal space in which they occur, but they are dynamic in 
nature and change with the environment (Larsen-Freeman 2017). This perspec- 
tive not only considers the traditional and individual factors such as age, moti- 
vation, aptitude and attitude, but also considers the underlying issues related to 
the learners as individuals in constant interaction with their historical and so- 
ciocultural, and sociopolitical contexts. Examples of these are issues related to 
learners' anxiety, emotions, values and beliefs about the language. In this vol- 
ume, programs such IMPACT (see Dickinson & Martinez (2022 [this volume])) 
and the FORMABIAP (Vallejos Yopán et al. 2022 [this volume]) serve as a couple 
of examples of projects that include sociolinguistic profiles of learners for peda- 
gogical and career-decision purposes. Such programs address the nature of the 
environment and the learners' willingness to communicate. Assessment within 
this kind of framework challenges traditional designs of instruments to measure 
learners' ability to communicate in the language. This requires seeing assessment 
and the learner's progress as a process rather than a product. It calls not for a 
one-time test to measure ability, but rather to study the needs of the students in 
a given context and their trajectory as language learners. It also includes validat- 
ing the different linguistic repertoires they bring to the classrooms and provide 
experiences that will allow them to overcome the challenges they face in and 
outside of the classroom. As Larsen-Freeman (2017) explains, "languages are not 
only acquired or learned, but lived” (Ros i Solé 2016). 

Assessment is also challenged by contexts in which monolingual ideologies 
continue to define what goes on in multilingual classrooms. Important pedagog- 
ical principles in an ecological approach are the creation of ecologically valid 
contexts, relationships, agency, motivation and identity. Some guidelines for ap- 
plying an ecological perspective in language assessment may include (1) notion of 
“localness” (Freeman 2000, Tudor 2003), (2) contexts, (3) cultures of learning (Tu- 
dor 2003; Cortazzi & Jin 1996), and (4) teaching-learning dynamics (Tudor 2001). 
In this regard, Silva in this volume calls for including multiple voices and agents 
in the placement and teaching of Brazilian Heritage Portuguese Community- 
schools, an ecological pedagogical approach that should be designed after care- 
fully examining the needs of the local community, the teaching approaches in 
practice and the dynamics between the learner, family and school respectively. 

An ecological perspective also defines the classroom and assessment differ- 
ently. While we have gained much knowledge about the purpose of assessment 
practices in the last decades, we have also become aware of challenges in apply- 
ing traditional concepts of assessment to classroom-based assessment and other 
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communities of practice outside the traditional classroom setting. Classroom as- 
sessments as the ones described in the present volume followed Turner's (2012) 
recommendations when involving the use of strategies by instructors to plan 
and carry out the collection of multiple types of information concerning student 
language use, the analysis and interpretation of data collected for assessment, 
the feedback received and how the information gathered helps make present 
and future decisions to enhance teaching and learning (2012: 65). As some of the 
chapters in the present volume included examples of classroom assessment tech- 
niques used in Higher Education in the US, those assessments must be regarded 
as unique to a given teaching context and, therefore, approaches to classroom 
assessment validity need to be dynamic, sociocultural in nature and different de- 
pending on the community of speakers and learners. The multiple alternative 
assessments proposed in the present volume may fit well under edumetric ap- 
proaches to validity in assessment as they all aimed to promote and foster good 
learning behavior and successful progress. Under these parameters, assessment 
processes become an essential part of everyday classroom practice and involve 
both instructors and learners in reflection, dialogue and decision making with 
the ultimate goal of using assessment FOR learning (AfL: Assessment Reform 
Group, Broadfoot et al. 2002, Leung & Rea-Dickins 2007). 

Returning to the analogy posed in the Introduction of the present volume 
(Chapter 1), we view the dynamics and shaping of language and its related assess- 
ment as a continuous fractal formation similar to those fractals that are every- 
where in nature. Ecologists have found fractal geometry to be an extremely useful 
tool for describing ecological systems. Population, community, ecosystems, and 
landscape ecologists use fractal geometry as a tool to help define and explain the 
systems in the world around us. The fractal dimension is conceived as a mea- 
sure of the nature of habitats. In language contact and education settings, the 
habitats are communities of practice. Different tools are required in population 
ecology because the resolution or scale with which field data should be gathered 
is attuned to the study organism (individual learners in educational contexts). 
Insect movements and plant root growth follow a continuous dynamic path but 
the tools required to measure this continuous pathway are very different. De- 
spite multiple shared characteristics of learners' profile, the assessment tools are 
unique and different depending on the habitat (e.g. classroom walls, community- 
based learning). In order to avoid habitat fragmentation that produces isolated 
patches (minority language profiles such as heritage language learners for in- 
stance), fractal formation and assessment need to be accessible and inclusive to 
all in an equitable manner and should keep evolving in varied patterns. 
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3 Looking ahead: Future directions for research on 
alternative assessment in language learning 


3.1 Challenges of implementing inclusive approaches to assessment in 
higher education 


One of the strongest influences of assessment in higher education is validity the- 
ory (Phakiti & Isaacs 2021, Brown & Trace 2017). Both formal and informal as- 
sessments need to take into account validity and clear standards in order to elicit 
data to support learners and to design curriculum. Scholars have argued different 
dimensions of validity in assessment and the consequences for learners. McNa- 
mara & Roever (2006) argued that for the most part, language research investi- 
gates technical aspects of validity and not the social dimensions. In other words, 
assessment is designed for a given context and the impact on this particular com- 
munity of practice should be considered within construct validity (the extend to 
which the assessment instrument is intended to measure), content validity (the 
inclusion of content that is within the scope of the course material covered in 
class), criterion related validity, and consequential validity (the intended or un- 
intended consequences of assessment for the learners, for instance, being able to 
graduate or join a program). 

Another issue is psychometric test validity when assessing learners in class- 
rooms. As Phakiti & Isaacs (2021) argued, "classroom assessment scores cannot 
be correlated with other external test scores because classroom assessment is 
used to help the students to improve their skills and overcome any learning dif- 
ficulties through instructional support" (2021: 9). Assessment quality should be 
the approach. In their model, the authors proposed the following components for 
what they called assessment quality rather than validity. This model includes the 
following components: (1) validity, (2) reliability, (3) practicality, (4) authenticity, 
(5) ethics, (6) fairness, and (7) effect. It also proposes to start with the intended 
learning outcomes, and that classroom activities and classroom assessment need 
to be aligned with the outcomes. 

Yet, the challenges classroom instructors continue to face are related to insti- 
tutional policies as well as the rise in standard tests assessment. This generates 
in some cases the need for teachers to focus on the tests rather than on the learn- 
ing process and improvement of their students. Another issue is that alternative 
forms of assessment require more time spent in the planning stages of the ac- 
tivities. The development of some assessment instruments such as rubrics and 
group activities to assess different language skills may also require cooperation 
between teachers. Depending on the class composition, there will be a variety of 
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challenges related to group work and task completion. However, these activities 
are more aligned with providing learners with opportunities to engage with their 
context. Awareness and understanding of assessment practices, institutional poli- 
cies, and students' academic needs as well as their sociocultural context should 
be considered in the design of assessment that fosters students' learning through 
assessment quality criteria. 


3.2 Computer-mediated communication and assessment in 
multilingual contexts 


The role of technology in assessment has evolved over the last two decades. 
The language learner of the 21st Century is constantly learning through dif- 
ferent computer-mediated communication outlets. Social media technology and 
our ability to text and communicate in different languages has revolutionized 
and expanded the way we communicate and use languages (Thorne et al. 2021; 
Crystal 2009; Thorne 2008) and how we assess language learners through the 
use of videogames (Thorne et al. 2012; Gee 2014). As global citizens, we have 
moved quickly from texting with limited characters and communicating a mes- 
sage through short texts, to smart phones and social media in which we can 
basically generate entire documents to share with a wide audience through mul- 
timodal approaches to literacy. This has also facilitated processing information in 
different ways and through multiple languages including the use of technology 
and netspeak (Crystal 2009). These technologies have challenged our reality and 
altered how we communicate in real time with others around the world. Learn- 
ers are now more interested in learning foreign languages due to their particu- 
lar interests. Watching anime cartoons, reading comic books such as Manga for 
Japanese learning, and playing videogames, are examples of the motivations for 
younger generations to use language. Assessment practices are also challenged 
by these new ways of learning. As such, in multilingual contexts learners are 
tested in two or more languages simultaneously and their performance is as- 
sessed on how well they complete a given task instead of how well they validate 
and use one of their languages. In this regard, Larsen-Freeman (2018) fittingly 
points out that “while this type of assessment may not be widely adopted any 
time soon, computer adaptive testing may well lend itself to more developmen- 
tally sensitive, self-referenced assessment, instead of approaches that resemble 
traditional standardized exams" (2018: 63). 

Recent events such as the pandemic and natural disasters are forcing language 
educators to rethink assessment during these challenging times. Alternative as- 
sessments become the way in which the world continues to collaborate through 
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synchronous and asynchronous instruction. This has also generated new oppor- 
tunities to engage with learners in different ways that were not previously con- 
sidered by more traditional assessment methods. 

The present volume aimed to provide a snapshot of some alternative assess- 
ments that address different realities and needs and initiate a dialogue on future 
research and additional modalities of alternative assessments in language learn- 
ing in different communities of practice with other learner profiles. The limited 
scope of the research findings covered in this volume was due to the contexts the 
authors were operating mostly in Higher Education in the United States, and the 
Amazon of Peru and the languages involved (e.g. Heritage language learners of 
Spanish, Portuguese). Further research in language assessment should include 
additional language profiles in multiple communities of practice such as sign 
language learners, heritage language learners of other languages different from 
Spanish in the U.S. for instance, and study of language assessment in indigenous 
communities around the globe, to identify a few. Another area of much needed 
research would be assessment of language learning in hybrid and fully online 
educational settings. Additionally, pedagogical and assessment challenges (and 
solutions) remain to be fully explored when addressing disparities between for- 
mal and informal assessment practices, validity issues and teaching training. An 
interesting line of inquiry worth pursuing when advancing our knowledge on 
alternative assessments for language development would be to determine learn- 
ers’ (and also instructors’) dispositions by assessing how receptive they are to 
the proposed assessments, how willing they are to continue to learn about them, 
apply them, and be influenced by them. The research findings presented in this 
volume, though yielding more questions than answers, provides a promising re- 
search agenda and dialogue for scholars interested in assessment of language 
learning. 
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Language assessment in 
multilingual settings 


This volume explores and addresses questions related to equitable access for assess- 
ment. It seeks to initiate a conversation among scholars about inclusive practices in 
language assessments. Whether the student is a second language learner, a heritage lan- 
guage learner, a multilingual language speaker, a community member, the authors in 
the present volume provide examples of assessment that do not follow a single universal 
or standardized design but an applicable one based on the needs and context of a given 
community. The contributors in this volume are scholars from different disciplines and 
contexts in Higher Education. They have created and proposed multiple lower-stakes 
assignments and accommodated learning by being flexible and open without assuming 
that learners know how to do specific tasks. Each chapter provides different examples 
on Justice, Equity, Diversity, and Inclusion (JEDI) assessment practices based on obser- 
vation, examination, and integrative notions of diverse language scenarios. It may be of 
interest to researchers and practitioners in the fields of curriculum and instruction, lan- 
guage learning, and applied linguistics as well as those in the field of language teaching 
in general. Thus this volume broadens the scope of research in the area of multilingual 
assessment. 


